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ABSTRACT 


A  new  formulation  of  the  trajectory  sensitivity  problem 
is  developed  to  reduce  the  effects  of  modeling  errors  in  optimal 
control  systems.  Necessary  conditions  for  minimum  sensitivity 
are  obtained  from  a  measurable  quasiconvex  family  of  direction 
fields.  These  techniques  are  applicable  to  a  large  class  of  non¬ 
linear  systems  that  could  not  be  handled  previously  by  standard 
sensitivity  methods. 

The  principal  result  is  a  complete  theory  for  the  prac¬ 
tical  design  of  minimum  sensitive  linear  feedback  compensators . 
Sufficient  conditions  are  developed  from  new  theorems  relating 
conjugate  points  to  the  positive  definiteness  and  controllability 
of  the  accessory  minimum  problem.  The  advantages  of  the  min¬ 
imum  sensitive  compensator  relative  to  least  square  parameter 
estimators  are  discussed.  An  example  illustrates  the  improved 
sensitivity  characteristics  of  the  compensator  as  compared  to 
model  following  and  regulating  controls. 
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Chapter  1 
Introduction 

1.1  Problem  Statement 

The  dynamical  behavior  of  many  physical  processes  can  be  des¬ 
cribed  by  differential  equations.  The  ability  of  such  a  description 
to  correctly  predict  the  actual  system  response  Is  directly  related 
to  the  accuracy  of  the  mathematical  model .  Errors  In  the  model  can 
result  from  unsatisfactory  Initial  approximations  and  from 
actual  component  variations  after  the  model  has  been  produced.  When 
a  differential  equation  Is  used  for  controller  design,  the  resulting 
control  may  greatly  depend  on  various  parameters  In  the  model.  If 
these  parameters  remain  at  their  design  values,  the  control  Input  to 
the  actual  process  will  produce  the  desired  output.  However,  If  the 
actual  system  deviates  from  the  model ,  the  desired  output  may  not 
be  realized. 

Modeling  accuracy  Is  particularly  Important  In  the  practical 
application  of  optimal  control  theory.  Here  It  Is  assumed  that  the 
system  dynamics  are  described  by 


X  -  f  (t,  X,  u,  n)  ;  x(t^)  -  x., 


(1.1) 


where  x  Is  the  n  dimensional  state  vector  representing  the  process 
variables  and  T]^(t)  Is  an  m  dimensional  vector  of  uncertain  parameters. 
The  problem  Is  to  choose  an  r  dimensional  control  function  u. ,  assum¬ 


ing  that  n 
functional 


Hj,,  such  that  over  the  time  Interval  (t^,  tg)  the  cost 


J  »  /  ^  L(t,  X,  u)  dt 


(1.2) 


Is  minimized  subject  to  state  and  control  constraints  of  the  form 


^  (t,  X,  u)  <  0  . 


(1.3) 
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A  terminal  region  may  or  may  not  be  specified.  The  solution  of  this 
problem  yields  a  time  varying  control,  u_ *  u^Ct),  such  that,  when 
applied  to  (1.1)  with  the  parameter  vector  at  Its  nominal  value, 
n  *  Dfl*  optimal  trajectory,  Is  obtained.  There  are  many 

quantities  related  to  the  optimization  problem,  such  as  the  cost  funct¬ 
ional,  constraint  boundaries  and  terminal  manifold,  which  are  effected 
by  parameter  variations.  However,  all  of  these  are  related  to  the 
basic  objective  of  generating  the  desired  system  output 

The  problem  examined  In  this  dissertation  Is  the  realization 
of  Xp(t)  when  the  actual  system  deviates  from  the  design  system  through 
changes  In  the  parameter  vector  n.  The  trajectory  sensitivity  problem 
Is  thus  defined  to  minimize  or  reduce  variations  In  the  system  output 
«  X  -  caused  by  variations  or  uncertainties  in  the  modeling 
parameters,  An  *  n-n^. 

1.2  Previous  Work 

During  the  past  few  years  there  has  been  much  Interest  In  the 
sensitivity  of  control  systems,  particularly  those  which  are  optimal  In 
some  sense.  The  following  paragraphs  contain  a  short  description  of 
the  major  results  which  have  been  obtained  thus  far. 


Classical  Sensitivity  T echni ques 


Standard  methods  of  solving  the  trajectory  sensitivity  problem 
for  linear  systems  are  described  In  reference  [1]  through  [4].  The 
methods  basically  employ  feedback  as  a  second  degree  of  freedom  to 
reduce  output  errors  as  shown  In  Figure  1.1 


Figure  1.1:  Closed  Loop  Control  System 


The  first  degree  of  freedom  determines  the  nominal  plant  transfer 
function  or  operator  P  such  that 

yt)  =  P(u^(t))  .  (1.4) 

This  is  obtained,  for  example,  from  the  solution  to  an  optimal  control 
problem.  The  feedback  operator  H  is  then  determined  to  minimize  or 
reduce  sensitivity  to  plant  parameter  variations  5P  with  G  determined 
such  that  the  overall  (closed  loop)  transfer  function  is  nominally 
equivalent,  i.e.,  for  6P  =  0.  The  closed  loop  transfer  function 

is  thus 


)^  =  [  I  -  P  G  H 


PG  iJ 
— n 


(1.5) 


It  is  therefore  seen  that,  through  the  use  of  feedback,  the  structure 
of  the  original  transfer  function  or  operator  is  changed.  In  effect, 
two  separate  transfer  functions  P  and  D  could  be  respectively  determined 
to  realize  the  original  design  objectives  and  to  reduce  trajectory 
sensitivity.  The  synthesis  problem  would  then  be  to  compute  from 
these  the  operators  G  and  H.  To  date* no  practical  design  techniques 
.had  been  determined  to  generate  a  physically  realizable  feedback 
operator,  H,  which  minimizes  the  trajectory  sensitivity. 


Sensitivity  Operators 


The  original  definition  of  the  sensitivity  operator  (references 
[1]  -  [4])  for  single  input,  single  output  systems,  relative  to  a 
scalar  parameter  n,  is  given  by 


S 


P 

n 


/t) 


(1.6) 


where  P  is  the  nominal  plant  transfer  function  (1.4).  The  operator 
relates  normalized  changes  in  the  transfer  function  to  parameter 
variations.  Sensitivity  is  reduced  by  causing  S^^  to  be  as  small 
as  possible. 
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A  generalization  of  this  to  multivariable  systems  described  by 
linear  operators  was  given  first  In  [5]  and  later  In  [6]  through  [9]. 
It  Is  assumed  that  the  actual  plant  operator  Is  given  by 

P  »  P  +  6P  (1.7) 

a 

where  5P  Is  an  additive  parameter  variation.  Referring  to  Figure  1.2 
the  closed  loop  output  error,  ^  •  Is  related  to  the  open 

loop  error,  6^  *  P.  u.  -  ^  ,  as  follows 

6x.  =  N  6x^  (1.8) 

where 

N  =  [  I  -  P,  6  H 

CL 

but  reduces  to 

N  =  [  I  +  P  H  ] 

when  (SP  Is  small.  The  compensator  Is  then 

G  »  [  I  +  H  P  ]"^ 

for  nominal  equivalence.  It  was  shown  In  [5]  >  [9]  that  a  sufficient 
condition  for  sensitivity  reduction  defined  by 

II  II  ^  II  II 

was  that  the  operator  N  be  such  that 

[  I  -  N*  N  ]  :^  0  (1.9) 

when  N*  Is  the  adjoint  of  N,  or  that  N  be  a  contraction.  Some 
stability  conditions  have  been  obtained  for  linear  feedback  gains  In 
[8]  and  [9]  such  that  (1.9)  Is  satisfied.  In  general,  (1.9)  Is 
difficult  to  use  as  a  design  tool. 

Closed  Loop  Optimal  Systems 

Consider  a  general  optimal  control  problem  such  as  that  given 
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T 


t 


I 


by  equations  (1.1)  through  (1.3).  One  method  of  generating  a  feedback 
solution  Is  to  seek  the  optimal  control  as  an  explicit  function  of  the 
Initial  state,  x(ti).  Then  t^  can  be  treated  as  the  present  time  with 
x(t^)  the  present  state.  This  has  been  done  In  references  £10]  and 
[11]  for  linear  systems  with  quadratic  cost  functionals.  The  feedback 
gain  matrix  was  shown  to  satisfy  a  matrix  Riccatl  equation. 

Since  feedback  does  not  necessarily  Imply  sensitivity  reduction 
or  even  stability,  it  Is  of  Interest  to  examine  the  sensitivity 
characteristics  of  optimal  systems.  The  steady  state  regulator  was 
considered  In  references  [12]  and  [13]  with  nonlinear  optimal  systems 
being  Investigated  In  [14].  It  was  shown  In  [14]  that  for  relatively 
smooth  nonlinear  systems 

6x^"'’z  6x^  dt  <  6^'^  Z  6x^  dt  (1.10) 

^1  ^1 

where  Z  is  positive  definite  and  t'  Is  any  point  within  the  optimization 
Interval.  For  linear  quadratic  problems 

Z  =  R  K 

where  K  is  the  feedback  gain  and  R  Is  the  control  cost  weighting  matrix. 
In  addition.  It  was  shown  In  [12]  and  [13]  that  for  steady  state  linear 
quadratic  problems  (1.10)  is  equivalent  to  (1.9)  and  the  classical 
return  difference  function  [2]  Is  greater  than  one. 

In  most  cases,  the  optimal  control  cannot  be  obtained  as  an 
explicit  function  of  the  Initial  state  and  the  above  results  then  do 
not  apply.  Also  (1.10)  only  states  that  a  sensitivity  reduction  occurs 
and  gives  no  Indication  of  the  actual  amount  of  the  reduction. 

Sensitivity  Functions 

One  method  of  reducing  sensitivity  In  optimal  control  systems  Is 
to  Include  sensitivity  terms  In  the  original  cost  functional.  If  the 
resulting  control  Is  Implemented  at  a  function  of  time  (open  loop). 
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then  a  tradeoff  can  be  made  between  the  original  design  and  sensitivity 
objectives.  This  was  done  In  reference  [15]  however.  In  order  to 
achieve  a  significant  sensitivity  reduction,  the  original  design 
objectives  had  to  be  considerably  relaxed.  This  method  also  does  not 
yield  nominally  equivalent  solutions,  I.e.  the  original  (no  sensitivity 
constraints)  optimal  control  will  not  result  when  parameters  are  at 
their  nominal  values. 

For  the  linear  regulator  problem,  attempts  were  made  to  generate 
feedback  controls  with  sensitivity  terms  In  the  cost.  In  order  to  do 
this,  higher  order  sensitivity  terms  were  neglected  In  references 
[16]  and  [17].  This  approximation  was  avoided  In  [18]  by  treating 
control  sensitivity  terms  as  additional  control  functions.  The  result¬ 
ing  feedback  control  Is  linear  In  the  state  and  the  first  order 
sensitivity  vector,  which  Is  of  the  same  dimension  as  the  state. 
Therefore,  the  Implementation  of  this  requires  the  generation  of  the 
sensitivity  terms  by  a  dynamical  system  which  Is  approaching  the 
complexity  of  an  optimal  filter.  In  addition,  since  the  regulator 
solution  alone  reduces  sensitivity  by  (1.10),  It  Is  possible  that  the 
sensitivity  reduction  resulting  from  the  augmented  system  could  be 
simply  obtained  by  adjustment  of  the  terms  In  the  original  cost 
function. 

Model  Reference  Adaptive  Control 

A  particular  solution  to  a  control  problem  results  In  a  nominal 
Input  to  a  plant  with  a  specific  transfer  function.  For  this  Input, 
a  model  of  the  plant  can  be  constructed  which  gives  the  desired 
output.  The  model  reference  technique  [19]  compares  the  actual  output 
with  the  desired  output  and  then  adjusts  certain  control  parameters 
such  that  a  measure  of  the  output  error  Is  minimized.  Gradient  and 
steepest  descent  procedures  are  used  to  determine  the  control  parameters 
This  method  has  Inherent  stability  problems  In  addition  to  being 
difficult  to  Implement  due  to  Its  complexity. 


Linear  Estimation  and  Control 

Assume  that  for  the  system  defined  by  equation  (1.1),  an  optimal 
control  function  u^(t)  has  been  determined  with  n  =  Using  the 
resulting  optimal  trajectory,  x^(t),  as  the  nominal,  the  perturbation 
equation  of  (1 .1)  Is 

^  ♦  U  AH  *  0.11) 

where  all  partlals  are  evaluated  along  the  nominal  and  the  A  quantities 
represent  off  nominal  errors.  Let  some  linear  function  of  the  state 
error 

^  =  M  ^  +  d  (1.12) 


represent  the  measurements  where  ^  Is  Gaussian  noise  with  zero  mean 
and  known  variance.  Then,  assuming  disturbances  of  known  statistics 
on  (1.11)  and  the  linearized  dynamics  for  the  Kalman  filtering 
techniques  described  in  [20]  -  [22]  can  be  employed  to  estimate  ^ 
and  This  will  require  a  dynamical  system  of  dimension  (n-Hn). 

The  control  error,  can  be  determined  such  that  a  quadratic 
functional  in  ^  and  ^  is  minimized.  In  this  case,  references  [10] 
and  [11]  Indicate  that  ^w111  be  a  linear  function  of  ^  and 
Because  of  the  separation  theorem  (  [23]  and  [24]  )  for  linear,  quadratic 
problems,  the  optimal  filter  and  control  can  be  combined  to  yield  a 
dynamic  feedback  control,  Au  H  (Ay) .  This  is  a  good  solution  to 
the  first  order  sensitivity  problem  except  for  Its  complexity  and 
corresponding  Implementation  difficulties.  One  other  problem  is  the 
choice  of  state  noise  on  the  parameter  error  equation  to  keep  the  filter 
from  becoming  over  confident  (see  reference  [19]  ). 


Feedback  Ooerators  and  Controls 


One  technique  of  generating  feedback  controls  from  a  given 
optimal  control  Is  to  break  It  up  Into  functions  of  time  and  state,  e.g. 
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y.(t.x)  »  u^(t)  +  h(t,x) 


(1.13) 


where  h(t,x^)  ■  0  along  the  optimal  trajectory.  This  type  of  control 
has  been  termed  "partially  closed  loop"  since  ^(t,^  is  not  an  explicit 
function  of  the  initial  state.  It  was  used  in  reference  [25]  to 
combat  the  singularity  problem  in  final  value  control  systems.  Controls 
of  the  type  (1.13)  were  also  employed  in  reference  [26]  to  reformulate 
the  confined  optimal  control  and  sensitivity  problem  discussed  in  the 
section  on  sensitivity  functions.  The  formulation  basically  consider¬ 
ed  i^(t)  and  [  3h/3x  ]  as  control  functions  to  be  determined  by 
minimization  of  a  coupled  state-sensitivity  cost  functional.  Reference 
[26]  did  not  carry  the  problem  further  than  the  formulation. 

Some  interesting  results  have  been  obtained  by  Porter  in  [27] 
where  the  sensitivity  problem  was  formulated  using  Functional  Analysis. 
It  can  be  seen  from  (1.8)  that  for  small  parameter  variations, and  when 
the  compensator  is  H  *  X  P'^  with  X  a  scalar,  the  sensitivity  operator 
becomes 

N  »  (  1  -  X  )  I  . 

Thus  as  X  1  the  closed  loop  sensitivity  approaches  zero,  however,  the 
forward  loop  compensator  gain  (G)  then  becomes  unbounded.  The  major 
drawback  is  that  when  P  represents  a  differential  equation,  H  is  a 
differential  (unbounded)  operator  and  thus  is  difficult  to  implement. 
Also  proposed  in  [27]  is  the  following  problem.  Determine  the  operator 
H  such  that 

J  »  [  HR  6x^  II*  +  IIQH  6x^11*] 

is  a  minimum  where  Q  and  R  represent  appropriate  design  matrices  and 
the  5x  terms  are  as  defined  for  (1.8).  Using  Hilbert  space  techniques, 
the  solution  is 

H  -  a[I  ♦  oP*  P]‘^  P* 

6  -  [I  +  oP*  P] 


where  a  1s  determined  from  R.  When  P  represents  a  linear  differential 
equation,  the  control  error  Is  given  by 

tf  T 

^  »  -a  /  ♦  (tx.s)  ^(s)  ds 

t  ^ 

where  ^(0  Is  the  transition  matrix  of  P  and  t^  Is  the  final  time. 

The  feedback  control  thus  requires  knowledge  of  future  values  of  the 
state  and  Is  therefore  unrealizable.  It  should  be  noted  that  this 
result  can  also  be  obtained  using  methods  of  variational  calculus. 

1.3  Scope  of  the  Dissertation 

The  principal  objective  of  this  dissertation  Is  to  develop  a  new 
formulation  of  the  trajectory  sensitivity  problem  which  Is  applicable 
to  general  nonlinear  systems.  As  In  classical  sensitivity  methods, 
the  use  of  feedback  as  a  second  degree  of  freedom  plays  a  large  role 
In  the  theoretical  development.  To  this  end,  the  original  system 
(1.1)  with  the  control  and  parameter  vectors  at  their  design  values 
(y.  ■  M,,  *  n.  *  Dfl)  '•s  considered  as  the  nominal.  A  closed  loop  system 
function  £,(t,  X,  n.)  Is  then  sought  such  that  the  solution  to 

i  *  SL(t,  X,  Ti_)  ;  x(t^)  *  X;,  (1.14) 

remains  close  to  the  desired  output  of  (1.1),  2^(T).  when  n  differs 
from  T]^.  The  system  equations  (1.1)  and  (1.14)  are  related  through  a 
nominal  equivalence  condition,  I.e. 

fl.(t,  X,  Q^)  »  f(t,  x,  u^,  3^)  , 


An  additional  relationship  can  be  obtained  If  the  functions  g(*)  are 
generated  by  applying  feedback  controls  to  (1.1)  as  follows 


£(t,  X.  n)  »  f(t,  X,  u(t,x),  n)  , 


This  Is  one  possible  solution  to  the  synthesis  problem. 


! 
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In  Chapter  2  the  problem  of  determining  the  system  function  £(•) 
which  exhibits  minimum  output  sensitivity  to  parameter  errors  Is 
formulated  as  a  direction  field  problem  In  the  calculus  of  variations. 
Then,  from  a  general  class  of  measurable,  quasiconvex,  nominally 
equivalent  system  functions,  necessary  conditions  are  obtained  for 
extremal Ity.  The  extremal  function  effectively  results  from  a  trade¬ 
off  between  reduced  output  error  and  Increased  deviation  from  the 
nominal  (design)  system.  These  results  are  then  shown  to  be  applicable 
when  the  class  of  system  functions  Is  generated  from  feedback  controls 
applied  to  the  original  system. 

To  alleviate  the  synthesis  problem,  further  specialization 
Is  made  In  Chapter  2  to  the  class  of  linear,  time  varying  gain  feed¬ 
back  controls,  small  plant  parameter  variations  and  quadratic  cost 
functions.  The  necessary  conditions  thus  obtained  explicitly  determine 
the  feedback  gain  matrix  which  minimizes  the  mean  square  and  final 
value  first  order  trajectory  sensitivity.  Independent  of  the  parameter 
errors.  In  Chapter  4,  sufficiency  conditions  are  determined  using 
some  new  results  on  conjugate  points  derived  In  Appendix  B.  It  Is 
shown  that  the  minimum  sensitive  (MS)  gain  function  Is  determined, 
when  It  exists,  from  solutions  to  linear  differential  equations. 
Existence  problems  are  removed  through  the  addition  of  cost  penality 
terms  and  linear  approximations  to  the  modified  problem  are  then 
proposed.  The  theory  developed  In  Chapter  4  gives,  for  the  first  time, 
a  practical  method  of  designing  linear  feedback  compensators  which 
minimize  trajectory  sensitivity. 

The  remaining  chapters  correlate  presently  known  sensitivity 
reduction  techniques  to  those  of  Chapter  4.  Some  new  sensitivity 
relationships  are  derived  In  Chapter  3  for  model  following,  regulating 
and  stabilizing  controls.  A  comparison  example  Is  presented  In  Chapter 
5  which  shows  the  superior  sensitivity  characteristics  of  the  MS 
gain  function  relative  to  the  controls  discussed  In  Chapter  3.  In 
addition,  relationships  between  the  MS  compensator  and  classical 
sensitivity  techniques  for  linear  systems  are  derived  In  Appendix  A* 


It  Is  shown  that  the  feedback  compensator  of  Chapter  4  is  similar  In 
structure  to  classical  Input  conf>ensators  and  that  the  closed  loop 
system  error,  which  Is  employed  In  Chapter  2  to  limit  the  amount  of 
applied  feedback,  can  be  corresponded  to  the  transfer  function  for 
measurement  noise.  The  latter  Is  the  limiting  factor  for  classical 
sensitivity  reduction  techniques. 

Least  square  parameter  estimators  are  compared  to  MS  controllers 
In  Appendix  C.  It  Is  shown  that  both  have  similar  structures  when 
the  number  of  parameters  equals  the  state  dimension.  The  MS  controller, 
however.  Is  applicable  to  a  much  larger  class  of  problems  than  the 
estimator  and  also  Is  computationally  simpler  to  determine. 
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Chapter  2 


Direction  Field  Formulation 
of  the 

Trajectory  Sensitivity  Problem 


2.1  Introduction  and  Problem  Statement 

The  solution  of  an  optimal  control  problem  over  the  time 
Interval  [ti,  t2]  can  be  described  by  the  following  differential 
equation 


i„  •  I(t.  V  ;  (2.1) 

where  x,  ^  and  n  are  of  dimensions  n,  r  and  m  respectively.  The 
function  f(*)  Is  assumed  to  be  locally  Integrable  In  t  and  of  class 
(continuous  partial  derivatives)  In  x,  ^  and  n.  It  Is  also  assumed 
that  the  parameter  vector  n(t)  evolves  according  to 

n  *  i(t,  T}^)  ;  n(t^)  =  (2.2) 

where  t(«)  Is  a  fixed  function  that  Is  locally  Integrable  In  t  and 
In  n.  The  solution  of  (2.1)  Is  given  by 

x„(t,  T^)  *  x^(t)  (2.3) 

which  Is  the  desired  optimal  trajectory.  Assuming  that  all  Initial 
condition  errors  are  accounted  for  In  ^(t).  variations  In  the 
modeling  parameters,  An  >  n(t)  -  n.(t),  result  In  the  open  loop  system 

Xo  -  f(t.  Xq.  Ufl.  IL)  i  5o^t,)-ini  .  (2.4) 

The  corresponding  open  loop  trajectory  Is  thus 

XQ(t,  n)  »  x^(t)  (2.5) 

which  Is  absolutely  continuous  In  t  and  In  q.. 


Feedback  can  be  employed  as  a  second  degree  of  freedom  by 
defining  the  closed  loop  system  as 

.  x»a)  i  (2.6) 

where  £(•)  Is  a  member  of  a  certain  class  of  functions  G  to  be 
specified  In  the  next  section.  Each  £(•)  ^  6  satisfies  the  nominal 
equivalence  condition 


a(t,  X,  *  f(t,  X,  u^,  3^)  .  (2.7) 

Therefore  (2.6)  defines  a  class  of  direction  fields  about  f(»)  which 
Is  parameterized  by  n^(t).  In  order  to  solve  the  trajectory  sensitivity 
problem  defined  In  Chapter  1,  a  function  g,(*)  ^  6  must  be  chosen  such 
that  the  solution  of  (2.6),  x(t,  n),  minimizes  some  function  of  the 
error 

Ax(t,  n)  =  x(t.  a)  -  (2.8) 

over  the  original  optimization  Interval  [t^  t^].  For  practical 
reasons  such  as  system  noise  and  original  design  constraints,  g(*)  must 
also  be  chosen  to  limit  some  function  of  the  system  error 


Aa(t,  x,n)  *  a(t,  x ,  n)  -  f^(t,  x,  u^,  n)  ,  (2.9) 


This  represents  the  deviation  of  the  closed  loop  system  from  the  open 
loop  system.  The  trajectory  and  system  errors,  (2.8)  and  (2.9)  can 
be  combined  Into  a  general  cost  function 


0(t2,  Aa) 


^(t2.  Ax) 


L(t,  Ax,  Ag,)  dt 


or  equivalently 

J 


I(t,  X,  a*  sl(*)  ) 


(2.10) 
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where  !(•)  Is  assumed  to  be  locally  Integrable  In  t  Y^C*)  €  G  and 
WRT  X,  Hand  g_(*)*  The  above  cost  effectively  trades  off  trajectory 
sensitivity  for  closed  loop  system  error.  The  problem  is  thus  to 
chooses,(*}  ^  G  such  that  (2.10)  is  minimized  subject  to  (2.6). 

2.2  Necessary  Conditions  for  Minimum  Sensitive  Closed  Loop  System 
Functions 

In  the  following  paragraphs*  the  class  of  admissible  functions 
G  will  be  defined  along  with  a  general  concept  of  an  extremal.  Then 
necessary  conditions  will  be  derived  for  the  closed  loop  system 
function  which  minimizes  trajectory  sensitivity. 

Admissible  Class  of  Functions 

Let  G  be  an  n  dimensional  family  of  functions  h)  where 

t  €  T  -  a  bounded  Interval 
X  6  -  an  open  subset  of  r” 

R^  -  an  open  subset  of  r” 

It  is  assumed  that  the  following  hold  for  each  c|,(*)  ^ 

a)  Each  £(t,  x,  q)  is  measurable  in  t  e  T  for  each 

X_  €  R  *  H  ^  • 

XT)  1 

b)  The  functions  h(*)  'In  class  C  WRT  x  and  h* 

c)  To  each  g.(*)  ^  G  and  compact  subset  S  c  r  x  R  ,  3  an 

A  n 

integrable  function  m(t)  on  T  st  ¥  x,  h€  s 

II  a(t,  X ,  n)  II  <  m(t) 
iiflx^^*  X »  n)  II  <  >"(0 
llfl|^(t»  X  •  q)  II  <  "’(t) 

where  the  norms  are  the  standard  vector  and  matrix  norms  in 
Euclidean  space.  ^ 

d)  Define  -  {  a  €  R**;  o.  >  0.  r  a.  -  1  ) 

'  i-1  ^ 


[G]  ■  convex  hull  of  G 


[G]  -  {  :  a^(t,  X ,  rj) »  a^  (t,  X,  a)  » 

O  e  P**  ,  e  G  } 

Then  to  each  set  {  €  g  }  i  «  l,...,b,  a  g  p**,  and 

c  >  0  3  g“  €  G  St  the  function 

b  . 

h(t.  X,  a;  a)  “  a  (t*  2L*  n.)  -  2.»  a) 

satisfies  the  following  conditions 

di)  3  an  integrable  function  m(t)st 

II  h(t.  X,  a*,  a)  II  <  n>(t) 
llh^(t,  X,  a;  a)  II  <  in{t) 

llh^(t,  X,  ai  “)  II  <  iwCt) 

¥  X.  a€  S  ;  t€T  ;  a€  P*^ 

d,)  II  /*2  h(t,  X,  a;  a)  dt  II  <  e 
^  t' 

V  X.  a^  s  ;  ae  p*^  ;  t'^,  t'g  e  T 

dj)  For  each  sequence  (  }  g  P*’  st  -►  a  e  p^ 

as  j  -►  *  and  each  6  >  0, 

u{t:  II ^(t,  x_,  a’»  2L^)  "  x»  a*  D  II  ^  0 

asJ-^oB  V£,  a^^  where  visa  Lebesgue  measure 
on  T. 

e)  Each  a(*)  Is  nominally  equivalent  URT  a* 
a(t»  2L*  ap)  •  2L*  Df))  . 

Assumptions  a),  b)  and  c)  are  basically  minimal  requirements  for  the 
differential  equation  (2.6)  to  have  a  unique  solution  (reference  [30]). 
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The  quasi  convexity  assumption  d)  Is  employed  to  assure  that  enough 
functions  are  In  G  for  the  extremal  problem  to  be  meaningful. 

Definition  of  Extremal Ity 

For  some  element  £(•)  €  G,  the  system  differential  equations  are 


X  =  £.(t,  X,  n) 
n  *  A(t,  r\) 


(2.11) 


where  t(0  Is  defined  by  (2.2)  and  satisfies  the  same  conditions  as 
each  £.(*)  ^  G  WRT  t  and  although  It  Is  a  fixed  (or  given) 
function.  The  solution  to  (2.11)  Is 

x(t,  n)  ,  ri^(t)  ;  t  e  T 

where  both  are  absolutely  continuous  a.e.  In  t  and  C^URT  Q^wlth 
boundary  conditions  either  Implied  or  explicitly  stated 

2.(^1 )  *  x^  ;  *  Xg 

!l(^-|)  ®  I]  »  ]l(^2^  *  ^ 

Let 

Rxn  -  (t^  t2.  xp  a,,  xg.  ng)  €  R2(n+fl'+l)^  (2.i2) 

Define  a  set  Q  c  ^^(n+m+l)  containing  all  points  q  corres- 

aT) 

ponding  to  all  solutions  of  (2.11)  for  all  £(•)  e  G.  An  extremal  will 
be  defined  In  terms  of  a  given  differentiable  manifold  NcR2(n+m+l) 
with  boundary  M  as  follows. 

Definition:  The  solution  7,  a  (2.11)  for  some  a(»)  €  G 
Is  a  G  -  N  extremal  If  q--  E  M  and  If  3  an  open  neighborhood 

An 

u  3  qj-  St  u  n  N  n  Q  c  M  . 

The  above  Implies  that  at  qr-  the  sets  N  and  Q  are  separated  In  some 

An 


sense. 


The  manifold  N  can  be  defined  In  terms  of  the  sensitivity  problem 
by  considering  the  cost  function  J  given  by  (2.10).  Adjoin  to  the 
state  vector  x(t)  the  quantity  x^^^ij[t)  defined  from 

=  I  (t,  X.  n,  a(*)  )  ;  ’‘(n+l)^^!^  “  °  (2.13) 

and  extend  Q  to  include  all  points 

‘^xn  ^  ^2’  -1’  ^(n+l)^^!^’  -1’  ^{n+1  )^^2^ 

Using  the  fact  that  the  optimization  interval  Is  fixed  along  with  the 
Initial  state  and  parameter  vectors,  define  the  differentiable  mani¬ 
fold  N 

(Vl,  V2,  £.1,  ?1,  Xl  »  £2*  ^2,  X2) 


given  by 

Vl  =  ti  ,  V2  =  t2 

ii  “  i.1  .  *  0  .  Xi  *  Hi 


(2.14) 


which  are  fixed  quantities  and  by 

i.  € 

I2  €  R^  (2.15) 

where  Is  the  minimum  of  J.  Thus  N  is  a  subset  of  at  most 

dimension  (n+m+1).  The  boundary  M  Is  given  by  all  relations  defining 
N  except  that  the  one  Involving  ^2  Is  replaced  by 

“  ^(n+l)^^2^  . 


(2.16) 


Necessary  Conditions 

Let  G'  be  an  (n-Kn+1)  dimensional  family  of  functions  given  by 
g!  (t,  z)  =  [  gj(t,  X,  q)  ,  I(t.  X.  a,  £[(•)  ),  tj(t.  n) 

where 

i(t)  •  [  X^(t.  n)  .  a^(t)  r 

with  s[(*)  ^  6  and  _t(*)  a  function  previously  defined  satisfying  condi¬ 
tions  a)  through  c).  The  cost  Integrand  I(*)  Is  assumed  to  satisfy 
a)  through  d)  V-  £(•)  €  G.  Thus  each  g'(*)  €  S'  Is  an  admissible 
function.  The  quasiconvexity  condition  carries  over  for  t(*)  because 
It  Is  fixed.  Define  the  Hamiltonian  as 

H  (t,  2,  i)  =  !iJ(t)  a'  (t.  z) 

where  !|j.(t)  Is  an  absolutely  continuous  (n+m+1)  d1me»^4ioT»dl  vector 
function.  Note  that  H(*)  Is  completely  determined  by  the  choice  of 
a!(*)  €  S'* 

As  previously  stated,  the  sensitivity  problem  Is  to  choose 
a(*)  €  G  such  that  (2.10)  Is  minimized  subject  to  (2.6).  The  follow¬ 
ing  theorem  gives  necessary  conditions  for  the  minimizing  closed  loop 
system  function. 

Theorem  2.2;  Let  the  function  g(*)  ^  G  and  corresponding 
solution  7(t,  n)  of 

X  »  a  (t,  X,  a)  ;  Z(t^)  “  (2.i7) 


with  a(t)  given  by  (2.2)  minimize  the  sensitivity  cost  (2.10)  over  the 
Interval  [ti*  12"! •  Then  3  a  nontrivial  absolutely  continuous  vector 
jt(t)  on  [t^,  tg]  St  with  I  =  [  x*^,  the  following  holds 


I 


i 


where  2  (t,  z)  =  [  (t.  x.  I(t,  x,  a.  a(0  ).  (t.  n) 

and  ff  (t,  z,  t)  *  /(t)  2  (t.  D  . 

In  addition  ¥ 

^1 

i!  (t,  z)  Is  continuous  In  t  at  t-j  and  t2t  then  the  transversal Ity 
condition  Is  that 


g'  (•)  e  G' 

^9  _ 

ff  (t,  z ,  jij^)  dt  >  f  ^  H  (t,  z,  iji^)  dt  . 


[  H  (t.| ,  z,  ili),  -  H  (t2.  2,  jt^),  -  liJ(t^),  Hi^Ctg)  ] 

be  orthogonal  to  the  boundary  M  at  the  point  q-  . 

Proof:  The  above  conclusions  are  similar  to  those  of  Theorem 
2.1  In  reference  [29],  the  statement  and  proof  of  which  are  given  In 
sections  2  and  3  of  the  reference.  The  theorem  differs  In  that  [29] 
assumes  that  for  a  particular  £[  (•)  ^  6',  the  solution  z(t)  of 

I  *  2  (t,  2  ) 

on  the  Inverval  [  t^  t2  ]  Is  a  6'  -  N  extremal.  It  therefore  remains 
to  show  that  the  hypotheses  of  this  theorem  Imply  a  G’  -  N  extremal . 

To  this  end,  let  the  manifold  N  with  boundary  M  be  as  defined  In  the 
previous  section.  Since  the  cost  (2.10)  Is  a  minimum  and  Is  represent¬ 
ed  by  x^p.|.i)(t2)t  any  point  In  Q  will  be  such  that 

*(n+l)^^2^  ^  *(n+l)^4^  • 

Thus  the  Intersection  of  any  open  set  about  q-  with  Q  and  N  will  result 
^2  “  *(n+l)^^2^“  *(n+l)^^2^  which  Is  by  definition  In  M.  The 
solution  z  (t)  Is  therefore  a  G' -  N  extremal  which  completes  the  proof. 
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It  should  be  noted  that  the  nominal  equivalence  condition,  e). 

Is  not  explicitly  required  to  obtain  the  above  necessary  conditions. 

It  Is  a  synthesis  requirement  which  will  become  more  explicit  In  later 
sections  of  this  chapter  where  the  class  of  system  functions  Is  gener¬ 
ated  by  nominally  equivalent  feedback  controls. 

If  the  cost  function  (2.10)  Is  sufficiently  convex,  certain 
bounds  can  be  obtained  on  the  minimizing  closed  loop  system  (2.17). 

For  example,  when  no  restriction  Is  placed  on  the  system  error 
Ag.(t,  X,  n)  given  by  (2.9),  then  the  output  error  and  equivalently 
the  cost  J  can  be  made  zero  over  [t^,  t2]  by  choosing 

a  (t,  X ,  n)  =  f(t,  X,  u^,  n^)  , 

This  not  only  requires  knowledge  of  the  parameter  riit)  but  controll¬ 
ability  as  well.  If  no  restrictions  are  placed  on  the  output  error, 
then  zero  cost  will  result  from 

a(t,  X .  n)  »  f(t,  X,  u^,  n) 

which  Is  the  open  loop  system.  It  Is  therefore  seen  that  particular 
choices  of  the  cost  functional  (2.10)  can  not  only  alter  the  closed 
loop  system  function  but  also  the  synthesis  problem. 

2.3  Generation  of  System  Functions  Using  Feedback  Controls 

The  standard  technique  of  producing  closed  loop  systems  Is  by 
applying  feedback  controls,  u.(t.  x),  to  the  original  system  (2.1)  In 
place  of  the  open  loop  control,  14,(t).  Thus  (2.6)  becomes 

X  *  f(t,  X,  u(t,  x^),  q)  ;  x(t^)  »  x^^  ^  (2.18) 

If  u(t,  x)  Is  nominally  equivalent,  I.e. 

“(t.  x^)  •  MflCt)  (2.19) 

then  (2.1)  will  be  realized  when  the  parameters  are  at  their  nominal 
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values.  In  this  section,  the  explicit  problem  of  determining 

a  feedback  control  law  which  minimizes  (2.10)  subject  to  (2.18)  will 
be  considered.  Therefore,  let  be  an  n  dimensional  family  of 
functions  defined  by 

Gy  *  <  a(t*  i.»  n.)  5  a(t.  x .  a)  *  f(t.  x,  u(t,  x),  3,)  ;  u(0  e  u) 

(2.20) 

where  the  set  U  of  admissible  controls  Is  defined  below  and  f(*)  Is  the 
original  system  function  given  by  (2.1).  If  the  class  can  be  shown 
to  be  admissible,  which  implies  satisfaction  of  conditions  a)  through 
e)  of  section  2.2,  then  Theorem  2.2  can  be  applied  to  determine  the 
minimizing  control. 

Let  U  be  the  set  of  all  control  functions 
u(t,  x)  :  T  X  Y 

where  T  and  are  defined  In  section  2.2  and  Y  is  a  fixed  set  In  r'^. 

It  Is  assumed  that  for  each  u(*)  ^  U  the  following  conditions  hold, 

m)  Each  u(t,  x)  Is  measurable  In  t  e  T  for  each  x  ^  ’ 

n)  The  functions  u(*)  are  In  class  WRT  x. 

o)  For  every  u^(t,  €  U,  f{t,  )^,  u^(').  a)  measurable  In 

t  and  WRT  x,  u,  n,  and  compact  subset  S  c  r  x  R_, 

_  X  3 

3  an  Integrable  function  m(t)  possibly  depending  on 
S,  f(*)  and  u(*)  St  ¥  x,  S 

II  f(t,  X,  u^(t,  x),  3.11  <  m(t) 

llf^(t,  X,  u(t,  x),  3)  II  <  m(t) 

llfy(t,  X,  u^(t,  x),  3.)  •  u^  (t,  x)  II  <  m(t) 

llf^(t,  X,  u(t,  x^),  3.)  II  <  m(t) 

where  11*11  represents  the  Euclidean  norm. 
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I  •  , 

K'' 


p)  The  control  function 

r  (t.  x)  .  t  e 
y!  (t.  x)  *  I  u*  (t.  x)  .  1 1 

is  in  the  class  U  where  u^(*).  u*(*)  ^  U 

q)  The  control  functions  are  nominally  equivalent,  i.e. 

u(t,  x^)  =  u^{t)  . 

Conditions  m)  through  o)  are  included  to  assure  unique  solutions  to  the 
differential  equation  (2.18).  Property  p)  guarantees  that  control 
perturbations  such  as  those  used  in  [32]  are  admissible. 

The  next  Theorem  extends  the  results  of  [29]  for  time  varying 
controls  to  include  feedback  control  functions. 

Theorem  2.3:  The  class  of  system  functions  6^  defined  by  (2.20) 
using  controls  u.(t,  x)  €  u  is  admissible,  i.e.,  the  functions  satisfy 
conditions  a)  through  e)  of  section  2.2. 

Proof:  From  the  assumptions  on  the  original  system  function 
given  by  (2.1)  and  conditions  m)  through  o)  defining  U,  it  is  seen 
that  conditions  a)  through  c)  are  satisfied  for  each  g(*)  €  G^.  Also, 
by  definition  of  nominal  equivalence,  q)  implies  e).  It  therefore  re¬ 
mains  to  show  that  condition  d)  holds. 

Let  the  functions  {  g.^( •)  ^  Gy}»  1  •  1  .•  •  •  .b  be  given  along  with 
a  e  P^,  compact  subset  S  c  R  x  R  and  scalar  e  >  0  where 

A  i] 

i^(t,  X,  0.)  »  f(t,  X,  J  (t,  X^),  T])  ;  u^(.)  €  u  .  (2.21) 

It  is  desired  to  show  that  3  a  control  u°‘(t,  x)  €  u  such  that  the 
function 

i 

h(t*  x»  “i  a  vt*  x»  a)  -  2.*  a  (t*  *)•  a)  (2.22) 


satisfies  condition  d).  In  particular  the  quasi  convexity  condition  62). 
In  what  follows  the  control  will  be  shown  to  be  of  the  form 


u“(t.  X)  .  g'd.  X)  ;  te  E,J,  j  •  1 . K 

where  the  are  disjoint,  x  e  s  and  E^jC  T.  The  method  of  proof 
Is  similar  to  that  of  Lenna  4.1  In  [29]; however, the  structure  Is  much 
less  complex. 

It  was  shown  In  [29]  that  there  exist  continuous  functions  on  TxS 
arbitrarily  close  to  ^^(t,  n)  In  the  topology  defined  by  Thus 
for  the  remainder  of  the  proof,  the  g  (•)  will  be  assumed  continuous  In 

t  for  fixed  x  and  Partition  T  =  [  t^ ,  t^  ]  Into  disjoint  sub¬ 

intervals  I.,  j  =  1,...,K,  and  choose  K  sufficiently  large  st  ¥  x,  nes 
and  1  -  l,...,b,  the  following  holds 

II  g^tj,  X,  a)  -  a’  (t' ,  x,  a) «  <  V2t  (2.23) 

II  /  S  a.  a’(t,  X,  a)  dt  -  A(K)  ((  <  V2  (2.24) 

T  1=1  ^ 

where  ^ 

A(K)  =  Z  Z  a^t.,  X,  a)  li  (2.25) 

j=l  1-1  '  J  J 

and  t'  ,  t.  €  I  It  Is  possible  to  do  this  by  definition  of  the 

w  J 

Integral  and  of  continuous  functions  and  since  S  Is  compact.  Now 
further  divide  each  I.  Into  b  disjoint  subintervals 

w 


'1J  •  “1  'J 


Note  that 


E,,  = 


1=1 


U 


b 

I  a 
1=1 


1  = 


1  'j  “  'j 


.b 


(2.26) 


Thus  (2.25)  becomes 


K  b 
A(K)  »  Z  I 


1 


Define  the  control  function  as 


u“(t.  x)  =  J(t.  )0  i  teE^j  (2.27) 

and  note  that  u^(*)  €  u  by  condition  p).  From  (2.21) 

a^lt,  X ,  q)  »  f(t,  X.  u“(t,  x),  a)  .  (2.28) 

Thus  ¥  X ,  a  ^  S 

II  I  ^(t,  X,  ai  o)  dt  II 
b  . 

»  II  /  2  a.  g  (•)  dt  -  /  g“(*)  dt  II 

T  1»1  ^  T 


<  II  / 

T 

<  ^2  + 

<  ^/2  + 

<  ^/2  + 

<  E 


2  a^*)  dt  -  A(K)II+II  A(K) 


K  b 


2  £  a^(t..x,  a)  Eii 
j»l  1»1  J 


K  b 


2  £  II  /  (a  (t.,  X,  a) 

j-l  1-1  J 


K  b 
72T  2  I  E 


j-1  1»1 


a 


j 

T 

K 


-  Z 


j-1 


a“(*)  dt  II 
^  1 

£  /  a  (t.x.rOdtii 
'■'  E,j 

(t,  X,  a)  )  dt  II 


since  the  above  holds  on  a  subset  Ct'^*  tf^lcT,  condition  d^)  Is  net. 
Also  the  fact  that  h(*)  In  (2.22)  Is  generated  directly  from  f^(0 
Implies  that  d^)  and  d^)  hold.  Conditions  a)  through  e)  of  section  2.2 
are  satisfied, and  therefore  the  class  Is  admissible.  This  completes 
the  proof . 

Using  the  above  theorem,  It  Is  possible  to  compare  the  problem 


formulations  of  references  £29j  and  £31].  Gittleman  formulates  an 
extremal  problem  In  which  the  system  functions  must  satisfy  a  condition 
similar  to  property  p).  The  above  theorem  Implies  that  functions  which 
satisfy  this  property  are  quasiconvex.  Therefore  to  this  extent, 
Gittleman's  formulation  Is  Included  In  that  of  Gamkrelidze. 

2.4  Specialization  to  Small  Parameter  Variations,  Linear  Feedback 
Controls  and  Quadratic  Cost 

The  problem  of  synthesizing  from  the  class  U  defined  In  section 
2.3  a  feedback  control  such  that  the  necessary  conditions  of  Theorem 
2.2  are  satisfied  Is  In  general  a  difficult  task.  The  difficulty 
occurs  because  the  theorem  gives  no  conditions  for  the  structure  of  the 
minimizing  control  function,  u^(t,  x.).  In  what  follows,  further 
specialization  of  the  sensitivity  problem  will  be  made  such  that  the 
synthesis  question  Is  resolved  by  the  problem  formulation. 

In  addition  to  the  conditions  Imposed  on  the  admissible  class  of 
system  functions  G  and  on  the  control  set  U,  the  following  assumptions 
are  made. 

s^)  The  unknown  parameter  n  Is  a  scalar  constant,  I.e.  £(•)  «  0 
In  (2.2).  (Multiple  parameter  variations  will  be  con¬ 
sidered  In  Chapter  4.0). 

S2)  The  parameter  error. An  =  n  -  n^,  Is  sufficiently  small  such 
that  only  first  order  terms  are  required  to  describe  the 
system  behavior  relative  to  the  nominal. 

s^)  The  closed  loop  system  functions  are  generated  by  the  family 
G^  defined  In  (2.20)  with  the  control  class  U  restricted  to 
contain  elements  of  the  form 

u(t,  x)  =  Ui(t)  +  K(t)  x(t)  (2.29) 

where  iLi(t)  and  the  (rxn)  matrix  K(t)  are  essentially 
bounded  functions  (  £33],  £34]  )  with  \^{t)  determined 
for  nominal  equivalence. 

s^)  The  cost  functional  J  given  by  (2.10)  Is  quadratic  In 


i 


Ax(t,  n)  and  Aa(t,  x,  n).  i.e. 


J  »  J  AiJ(t2,  n)  D  AxCtg,  n) 


+  1  /  ^  [  a/  Q  Ax  +  Aa^  W  Ai  ]  dt 


(2.30) 


where  0  and  Q  are  (nxn)  positive  semi -def 1 n1 te  matrices 
and  W  Is  a  positive  definite  (nxn)  matrix.  Also,  Q  Is 
assumed  to  be  Integrable  and  W  essentially  bounded. 


Using  the  above,  explicit  expressions  can  be  obtained  for  the  cost 

(2.30)  and  system  differential  equations  (2.6)  which  Involve  only 
first  order  trajectory  sensitivity  terms. 

The  error  expressions  1n  (2.30)  are  evaluated  as  follows.  Since 
the  solution  of  (2.6)  Is  C^URT  n,  assumptions  s^)  and  S2)  Imply  that 


Ax(t,  n)  *  x(t,  n)  -  Xfl(t,  n^) 


r„  „  T 

3n  ^  ^  "  ’^n  J 


(2.31) 


l(t)  An 


where  s_(t)  represents  the  first  order  trajectory  sensitivity.  To 
determine  Aa(t,  x,  n),  note  that  from  s^)  and  S2) 


i(t.  X,  u^.n  )  •  f(t,  X^,  U^,  !,„)  +  [  |j  |i  +  |i  ]  4n 


aU.  x.n)  ■  9(t.  X„.  n„)  .  C  |i  *  |a  ]  An; 


where  all  partlals  exist  because  f(*)  and  £(•)  are  C^WRT  x  and  n.  Thus 
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Aa(  t,  X,  n)  »  a(t,  X.  n)  -  f(t,  X,  u^,  n) 

since  by  assumption  e)  £^(*)  Is  nominally  equivalent.  From  s^)  and 

(2.20) 

3g  _  H  ^  3u 

3x  “  3x  3u  3x 

^  =  iL 

3ti  ”  3n 

Equation  (2.32)  thus  becomes 

An/*  V  -  9^  9u  3x  . 

Aa(t.  X,  n)  -  ^  ^  ^  An 

which  yields,  from  (2.29)  and  (2.31) 

Aa(t,  X,  n)  =  U  (t,  x^.  u^,  n^)  •  K(t)  s(t)  An  ,  (2.33) 

Using  (2.31)  and  (2.33)  In  (2.30),  an  expression  for  the  cost  Is 


3f 

It  Is  assumed  that  ^  (t,  x^,  u^,  n,,)  Is  essentially  bounded  In  t  and 
of  rank  r.  Then  since  the  parameter  error  An  Is  uncontrollable  and 

the  matrix  [  3  '•s  positive  semi-definite  of  rank  r.  It  Is 

sufficient  to  minimize  over  K(t) 


where  R  Is  positive  definite,  essentially  bounded  and  of  rank  r. 
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It  remains  to  determine  a  differential  equation  for  ^(t).  From 
(2.18)  the  system  dynamics  are  given  by 

X  *  f(t,  X,  u^(t,  x),n);  x(t^)  =  (2.35) 

where  ^(0  ^  U  is  defined  by  (2.29).  From  s^)  and  S2)>  the  first 
order  expansion  of  (2.35)  is 


3n  - 


3f-.^ 

3x  -  3u  3x  -  3n 


(2.36) 


where  all  partials  exist  by  definition  of  f(*)  and  u^(*)  and  are 
defined  relative  to  the  nominal  x^(t),  u^(t)  and  n..  Also  since 
the  solution  of  (2.35),  x^(t,  n),  is  continuous  in  t  and  n»  ^  =  s. 
From  s^).  (2.36)  thus  becomes 

1  iy  i.  an  *^(t)  1  an 


s(t^)  =  0 


(2.37) 


where  and  are  integrable  in  t  and  is  essentially 

af 

Note  that  for  the  product  ^  *  K  to  be  integrable. 


bounded 

^  on  '  ou 

(inO, 

Holders  inequality  (  [33],  [34]  )  implies  that  at  least  one  of  the 
functions  must  be  in  l”.  Since  (2.34)  is  quadratic,  it  was  necessary 
to  assume  L*  for  both. 

Equations  (2.34)  and  (2.37)  define  a  subsidiary  minimization 
problem  which  determins  the  optimal  gain  function  K(t)  relative  to 
assumptions  s^)  through  s^).  The  advantages  of  this  formulation  are 
that  the  problem  is  linear  and  quadratic  and  that  it  is  independent 
of  the  actual  parameter  values.  From  (2.29)  the  desired  control 
input  to  (2.18)  is 

u(t,  x^)  »  U;j(t)  +  K(t)  x(t)  (2.38) 

or,  by  application  of  the  nominal  equivalence  condition  on  U;|(t), 

u(t,  x)  ■  u^(t)  +  K(t)  [  x(t)  -  x^(t)  ]  .  (2.39) 


It  Is  shown  in  Appendix  A  that  compensators  of  this  type  are  related 
to  classical  input  compensators  for  linear  systems. 

In  sunnary,  the  problem  has  been  reduced  to  that  of  minimizing 
the  cost  functional  (2.34)  subject  to  the  system  equation  (2.37)  over 
all  (nxr)  matrices  K(t)  of  essentially  bounded  functions.  If,  in 
section  2.3,  the  elements  of  K(t)  are  corresponded  to  u^(t)  and  simi- 
larily  ^(t)  to  x(t),  then  it  is  easily  seen  that  conditions  m)  through 
p)  are  satisfied.  Theorem  2.2  thus  gives  necessary  conditions  for 
the  minimizing  gain  K(t).  It  should  be  noted  that  a  solution  to 
this  problem  cannot  be  obtained  by  application  of  the  niaximum 
principle  [32]  or  standard  variational  techniques  [30].  For  these 
methods  to  be  valid,  the  system  and  cost  matrices  must  be  continuous 
instead  of  being  essentially  bounded  or  integrable  as  assumed  above. 


Chapter  3 

Reduced  Sensitivity  Solution 


3.1  Introduction 

The  problem  of  minimizing  (2.34)  subject  to  (2.37)  will  be 
deferred  until  Chapter  4.  In  this  chapter  the  main  consideration  Is 
the  sensitivity  equation 


£»As_  +  BKs_+g_  ;  s(t^)  *  0 


(3.1) 


where  the  A,  B  and  g  coefficients  respectively  correspond  to  those  of 
(2.37)  and  are  assumed  continuous  In  time.  Two  gain  functions  K(t) 
will  be  examined  which  in  some  sense  reduce  the  closed  loop  sensitivity 
^(t)  given  by  (3.1)  relative  to  the  open  loop  sensitivity  s^(t)  given 
also  by  (3.1)  but  with  K(t)  =  0  on  [t^t^].  One  function  Is  a  de¬ 
coupling  control  and  the  other  Is  the  regulator  gain. 

3.2  Model  Following  Control 
Sensitivity  Bounds 


Rewrite  equation  (3.1)  In  the  following  form 
s  «  H  s  +  a  ;  s(t^)  =  0 
where  the  (nxn)  system  matrix  H  Is  given  by 
H  =  A  +  BK 

It  Is  desirable  to  choose  K  such  that 


(3.2) 


(3.3) 


;  >  0 


(3.4) 


for  then  (3.2)  can  be  analyzed  as  n  uncoupled  scalar  equations.  If 
the  control  dimension  r  Is  greater  than  n  and  B  Is  at  least  of  rank 
n,  then  K  can  be  realized  by 

K  -  B^  [BB^]’^  [H  -  A] 
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But  If  r  <  n,  as  Is  usually  the  case,  techniques  such  as  decoupling 
[35]  or  model  following  [36]  must  be  employed.  A  simple  model  follow- 
Ing  technique  Is  described  In  the  next  section. 

In  what  follows.  It  Is  assumed  that  H  has  been  decoupled  as  In  (3.4) 
with  the  positive  scalars  being  constant.  Also,  to  obtain  realistic 
bounds  on  the  sensitivities,  a  disturbance  term  will  be  added  to  (3.1), 
1  .e. 

£  =  A  £  +  BK  £  +  2  +  BK  ^  ;  £(t^)  =  0  (3.5) 

where  d  represents  measurement  errors.  State  of  system  disturbances 
are  included  In  2-  Thus  (3.5)  becomes 

£=Hs^+2+[H-A]d  ;  l(t.j)  =  0 

or 

*1  *  “l*i  -  “(“l  *  -  (Ad),  .  (3.6) 

Then  for  1  =  1 , . . .  ,n  and  t  e  [t.j ,  12] 

ls^(t)|  <  M.  (t,  a^)  (3.7) 

where 

M,(t,  a,)  =  1  -  ]  [b,  ♦  a,  a,] 

b,  -  [g,  -  (A  d),]  and  a,  .  [d,]  . 


For  a  fixed  t'  e  [tpt2]  the  bound  behaves  as  follows  relative  to 
variations  In  a.. 


M(t',  a,)  .  b,(f  -  t,)  and  ,  M(f.  n,)  .  a,  . 


It  is  thus  seen  that  the  sensitivity  bound  approaches  that  of  the 
measurement  noise  for  large  system  (feedback)  gains.  For  a  fixed  o', 
and  t,  unbounded 

.  ‘'l 

M(t,  a' )  =  0  and  M(t.  a')  =  .^a;  +  3.  . 
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Thus,  depending  on  the  length  of  the  Interval  [t^,  t2],'a^  can  be 
determined  from  a  tradeoff  between  the  relative  magnitudes  of  the  state, 
b^,  and  measurement,  3^,  disturbances. 

Optimal  Model  Following 

The  problem  considered  In  this  section  Is  that  of  determining  the 
feedback  gain  K  such  that  the  system  given  by  (3.1)  performs  as  (3.2) 
with  a  fixed  system  matrix  H.  Treating  the  parameter  variation  term 
g^(t)  as  a  disturbance,  It  Is  desired  to  choose  a  control  function 
ii(t)  =  K(t)  i(t)  such  that 


s  =  A  s  +  B  u  ;  i(t^)  *  (3.8) 

performs  as 

1  =  H  s  ;  s(t^)  =  s^  ^  (3.9) 


To  this  end  the  following  cost  functional  ^s  employed 


J(u) 


[(i  -  Hs)^  Q(i  -  Hs)  +  uV  ]  dt  (3.10) 


where  Q  and  R  are  positive  definite  weighting  matrices  and  s.(t)  Is 
given  by  (3.8).  Letting  E  =»  A-H,  (3.10)  becomes 

J(u)  .  y  /'^[(Es  ♦  Bu)^  Q(Es  +  Bu)  +  u^Ru]  dt.o.ll) 
2  t,  -  - 

The  minimization  of  (3.11)  subject  to  (3.8)  Is  similar  to  the  regulator 
problem  discussed  In  [10]  and  [11].  Using  standard  variational 
techniques,  the  optimal  control  Is 

u(t)  =  R-l  [£  -  Q  E  sj 


where  R  «  [  B^  Q  B  +  R]  with  £(t)  and  s(t)  satisfying 


(3.12) 


(3.13) 


£  =  [  -A^  +  Q  B  £  +  E^II  +  Q  B  R"^  B^J  Q  E  s 

S  »  [  A  -  BR'^  B^  Q  E]  s  +  BR"^  B^  £ 


s(t^)  =  0  ;  £(t2)  *  0 

Setting  ^(t)  =  R^(t)  ^(t)  in  (3.13)  a  Riccati  equation  can  be  obtained 
for  R  as  described  in  [11].  Thus  the  desired  model  following  gain  is 

K(t)  =  [B^  Q  B  +  R]'^  B^  [R(t)  +  Q(H  -  A)]  .  (3.14) 


3.3  Regulator  and  Stabilizing  Controls 

In  this  section  the  sensitivity  problem  discussed  in  section  2.4 
will  be  slightly  restated  such  that  a  standard  solution  technique  can 
be  employed  to  obtain  the  feedback  gain.  The  cost  functional  will 
remain  unchanged,  i.e. 


=  \  i^(t2)  Di(t2)  +  \  [s^Qs  +  J  R  K  ^  dt  (3.15) 


where  all  matrices  are  assumed  continuous.  The  first  two  terms  represent 
final  value  and  mean  square  sensitivity  measures  whereas  the  last  term 
limits  the  amount  of  feedback.  In  the  sensitivity  equation  (3.1)  the 
parameter  error  forcing  term,  £(t),  will  be  treated  as  a  disturbance 
which  effectively  produces  initial  condition  errors  along  the  tra¬ 
jectory.  Thus  (3.1)  can  be  replaced  by 


£  =  A  £  +  B  K  £  ;  s(t^)  =  (3.16) 


where  s^  is  arbitrary.  This  method  of  treating  disturbances  has  been 
used  in  [37]  to  generate  linear  feedback  controls  for  optimal  nonlinear 
systems.  The  minimization  of  (3.15)  subject  to  (3.16)  was  discussed 
in  [11].  The  solution  is 
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C3.17) 


KCt)  =  -R'^  P(t) 


where  the  (nxn)  matrix  P  satisfies 

=  PA  +  A^P  -  PBR'^  B^  P  +  Q  ;  P(t2)  »  0  . (3.18) 

The  remaining  question  is  what  effect  does  the  approximation  of 
the  parameter  error  forcing  term  by  the  arbitrary  Initial  condition 
vector  have  on  the  first  order  sensitivity  given  by  (3.1)?  Let  the 
open  loop  sensitivity,  s^,  be  given  by 

§0  “  ^  5o  3.  5  §o^^l^  “  °  (3.19) 

and  similarly  the  closed  loop  sensitivity  by 


s^  *  A  +  B  K  s^  +  a.;  s^(t,)  «  0  (3.20) 


where  K  is  computed  from  (3.17)  and  (3.18).  The  following  theorem, 
which  is  similar  in  structure  to  that  of  [14]  for  linear  optimal 
systems,  states  that  a  sensitivity  reduction  does  take  place  with  the 
use  of  the  regulator  gain. 

Theorem  3.3:  The  regulator  gain  defined  by  (3.17)  and  (3.18)  when 
employed  as  a  feedback  control  (2.29)  causes  a  sensitivity  reduction  as 
follows: 


s  ^  RK  s  dt  <  R  K  L.  dt 

-c  -c  -o  -0 

^1 


(3.21) 


where  the  open  loop,  and  closed  loop  s^,  sensitivities  are  given 
by  (3.19)  and  (3.20)  and  t'e  (t^,  12). 

Proof:  Integrating  (3.19)  and  (3.20),  it  is  seen  that 


s^(t)  «  s^(t)  ♦  m(t)  (3.22) 

in(t)  «  -  4(t,  x)  B  K  s,  dx  (3.23) 

“  ^1 


where 
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and  ^(t,  t)  is  the  transition  matrix  corresponding  to  A,  I.e. 

♦  «  A  ♦  i  (j)  (t.  t)  =  I  .  (3.24) 

Let  N  *  R  K,  an  (nxn)  positive  semi -definite  matrix,  and  form  using 
(3.22) 

s_^  N  s_  -  s  ^  Ns  a  2m^  N  s,  +  m^  N  m 
-o-o-c-c  —  -c  —  — 

Thus  a  necessary  and  sufficient  condition  for  (3.21)  Is  that 

[  2  nJ  N  s  +  iiJ  N  m  ]  dt  >  0  .  (3.25) 

Substituting  (3.17)  Into  (3.23)  gives 

!!L(t'  )  =  /^'  ♦(t.  t)  C(t)  P(t)  s  (t)  dr  (3.26) 

^1 

where  C  =  B  R"^  .  A  differential  equation  for  m(t)  can  easily  be 

obtained  from  (3.26)  as 

maAm  +  C(t)  P(t)  s^(t)  ;  m(t^)  =  0  .  (3.27) 

Also  multiplying  (3.18)  by  m^  and  then  m  yields 

-  ^  [i/PmJa  -2iiJpCP^-!JpCPm  +  m^Qm 

where  (3.27)  was  substituted  for  A  m.  Now  the  above  can  be  Integrated 
between  t-j  and  t'  to  give 

-m^(t'  )  P(t'  )  m(t'  )  =  -  [2  J  PCP  s_  +  J  PCP  ttj  dt 

^1 

+  m^  Q  m  dt  . 
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But  since  P(t’  )  Is  positive  semi -definite  V  t'  €  (ti*  t2)  and  Q  Is 
positive  definite,  the  above  Implies  that 

[  2  J  PCP  ^  J  PCP  nj  dt  >  0  .  (3.28) 

^1 

Also  by  (3.17)  and  (3.26) 

R  K  *  P  B  R"^  R  R"^  B^P  «  P  C  P 


and  thus  (3.28)  Implies  (3.21)  which  completes  the  proof.  Note  that 
when  m^(t)  Is  nonzero  on  (t^  t'  ),  (3.28)  and  consequently  (3.21)  are 
strict  Inequalities.  This  will  usually  occur  for  nonzero  s^(t)  If 
(3.20)  Is  controllable. 

An  Interesting  corollary  can  be  obtained  from  Theorem  3.3  which 
explicitly  relates  stability  and  sensitivity  reduction.  To  this  end 
assume  that  the  system  matrix  A  In  (3.1)  Is  constant  and  stable 
(negative  eigenvalues).  Then  It  was  shown  In  [38]  that  the  equation 

-  I  =  A^  Y  +  Y  A  (3.29) 

has  a  unique  solution  Y  which  Is  symmetric  and  positive  semi -definite. 
Define  the  feedback  gain  by 

K  »  b'''  Y  ,  (3.30) 


Corollary  3.3:  The  use  of  the  gain  defined  by  (3.30)  and  (3.29)  as  a 
feedback  control  causes  a  sensitivity  reduction  as  follows: 


sj  K  s^  dt  <  K  dt 

4.  -c  -C  *  -0  -0 

tl  t^ 


(3.31) 


where  the  open  loop,  and  closed  loop,  sensitivltes  are  given 
by  (3.19)  and  (3.20)  with  A  a  constant,  stable  matrix  and  t'€  (t^,  t2). 
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Proof:  The  method  of  proof  is  similar  to  that  of  Theorem  3.3 
and  will  thus  not  be  repeated. 

It  should  be  noted  that  Porter  obtained  similar  results  in  [8] 
using  frequency  domain  techni<)ues;  however, it  was  necessary  to  assume 
that  the  time  interval  (ti*  t2)  of  control  was  unbounded.  Thus 
Corollary  3.3  effectively  extends  those  results. 


Chapter  4 

Minimum  Sensitive  Gain  Feedback  Control 
4.1  Introduction 

In  this  chapter  the  explicit  problem  of  determining  a  feedback 
gain  matrix  which  minimizes  (2.34)  subject  to  (2.37)  will  be  considered. 
An  additional  assumption  of  continuity  In  time  will  be  placed  on  the 
original  system  functions  so  that  standard  second  order  conditions 
can  be  applied.  The  minimization  problem  examined  In  the  remainder 
of  this  chapter  Is  for  completeness  restated  below. 

The  closed  loop  system  dynamics  are  described  by 

X  =  f(t,  X,  u(t,x)  .  n)  ;  x(t^)  *  (4.1) 

where  x^(«)  and  iq,  have  dimensions  n,  r  and  m  respectively  and  f(*) 


Is  continuous  In  t  and  WRT  x,  u^*)  and 

The  control  function  Is 

given  by 

u(t,x)  =  u^(t)  +  K(t)  x(t) 

(4.2) 

where  u^(t)  Is  determined  such  that 

x^)  »  u^(t) 

(4.3) 

with  x„(t)  and  u^(t)  being  the  nominal  solution  of  (4.1)  for  the 
parameter  a  *  .  The  problem  Is  to  determine  the  (rxn)  gain  matrix 

K(t)  such  that,  for  small  variations^  from  the  nominal  parameter  r]^  , 
the  actual  trajectory  x(t)  remains  close  to  ^(t)  over  the  original 
optimization  Interval.  It  will  Initially  be  assumed  that  n  Is  known 

A.  ■“ 

to  within  a  scalar  constant,  I.e.  n  -  n.  n  where  n.  Is  an  unknown 
magnitude  operating  through  a  known  direction  n  •  The  results  will 
later  be  extended  to  multiple  parameter  variations.  From  section  2.4, 
the  first  order  sensitivity  vector  s(t)  relative  to  n.  Is  described  by 

“  Q 


(4.4) 


i*  A(t)  £+  B(t)  K(t)  s  +_a(t)  ;  s(t^)*s^ 

where  A,  B  and  £  represent  the  partial  derivatives  of  (4.1)  WRT  x,  ^(O 
and  n  respectively  evaluated  along  the  nominal.  The  Initial  value  of 
the  sensitivity  vector,  will  normally  be  zero  since  the  parameter 
will  usually  not  affect  the  Initial  state  x^.| .  In  what  follows  It 
Is  assumed  that  the  original  problem  (4.1)  Is  defined  over  a  fixed 
time  Interval  [0,T]. 

The  sensitivity  cost  function  employed  In  this  chapter  Is  similar 
to  that  given  by  (2.34).  Two  measures  of  trajectory  sensitivity  are 

mean  square  =  i  Q  ^  dt 

^  0 

final  value  =  ^  l^(T)  D  ^(T) 

where  Q  and  D  are  positive  semi -definite  matrices  which  are  continuous 
In  time.  The  system  error  Is  limited  by  restricting  the  amount  of 
feedback  K(t)  x{t)  or  equivalently  K(t)  ^(t).  This  restriction 
can  be  Included  In  the  cost  by  the  addition  of  one  of  the  following 
functions 

F,  =  1  /^  [  z  z  R..  s.*  ]  dt 

'  ^  0  1=1  j=l  J 

F2  =  i  /^  [  J  k'^’r  K  s  ]  dt 
0 

where  R^j  >  0  VI ,j  and  R  Is  an  (rxr)  positive  definite  symmetric 
matrix,  both  of  which  are  continuous  In  time.  The  term  F.|  restricts 
each  state  feedback  component  whereas  F2  restricts  each  control 
component.  The  use  of  either  F^  or  F^  depends  on  the  number  of  unknown 
parameters  and  will  be  discussed  further  In  the  sequel.  For  scalar 
parameter  variations,  F^  can  be  combined  with  the  trajectory  sensitivity 
measures  to  yield  the  following  cost  functional 
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J{K)  -  i  J(T)  D  sCT)  +  i  /"^E  J  Q  s  +  I  2  R..  K*  s  dt  (4.5) 

-  Z  Q  ^.1  j,-|  IJ  J 

which  effectively  trades  off  the  cost  of  feedback  for  reductions  In 
trajectory  sensitivity.  The  problem  Is  thus  to  determine  K(t)  such 
that  (4.5)  Is  minimized  subject  to  (4.4). 

The  following  sections  contain  necessary  and  sufficient  conditions 
for  the  existence  of  the  minimum  sensitive  feedback  gain.  In  addition, 
the  relationships  between  minimum  sensitive  control  and  least  square 
parameter  estimation  are  discussed  In  Appendix  C. 


4.2  Necessary  Conditions  for  Minimum  Sensitivity  with  State  Feedback 
Cost 

Necessary  conditions  for  the  problem  posed  In  section  4.1  can  be 
obtained  by  straightforward  application  of  variational  methods  given 
In  [30]  and  [40].  The  Hamiltonian  Is  defined  as  follows: 


H,(t,  s,  K.  E)  -  -  ^  K,=  sj 


1.2 


(4.6) 


+  £^[As  +  BKs+a]  . 

The  adjoint  equation  Is  given  by 

i  ■  -  V,  H,  .  Q  s  ♦  1  7^  t  K,j  -  E^A  -  e'bK  (4.7) 

with  £(T)  =  -  D  ^(T) 

The  optimal  gain  K(t)  Is  found  by 

dH-i  n 

siq-j  ■  ■  "u  "u  *j'  *  "t  *41  'j '  ® 
which  yields  for  Sj  0 


40 


1 


(4.8) 


^d 


n 

£ 

A=1 


The  general  form  of  the  canonical  equations  can  be  found  by  substitut¬ 
ing  (4.8)  Into  (4.7)  and  (4.4).  The  dth.  component  of  (4.7)  Is  as 
follows 


^  *  i, 


-  2  £  p.  Bj.K.. 

1*1  £*1  ’  *'J 

*  i=l  "  1-1 

*  i,  c 1  ’ 

where  the  bracket  term  Is  zero  from  (4.8).  Thus  (4.7)  becomes 

i«-A^£+Qs  ;  £.(T)  *  -  D  s.(t)  .  (4.9) 


Similarly  the  dth  component  of  (4.4)  Is 

n  r  n 


S.  »  £ 

^  1-1 

Nd 

+  £  £  Bi  K  .  s.  +  g. 

£«1  i«l  JX.  ft!  1  J 

n 

r  n  ,  n 

+  £  Bj.  £  B —  £  p  B  .  +  g^ 

t-1  1-1  m»l  J  • 

-  £ 
1-1 

^di  *1 

Defining 

V  - 

iy 

1 

t  -  y  (4.10) 

• 

The  above  becomes 

0 

t  j*  y 
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s^»A^+BVB^£+3.  i  l(0)  *  0  .  (4.11) 

Thus  the  canonical  equations  (4.9)  and  (4.11)  are  time  invariant  when¬ 
ever  the  sensitivity  equations  and  cost  matrices  are  independent  of 
time.  The  linearity  therefore  allows  a  closed  form  solution  for  the 
gain  terms  given  by  (4.8).  Note  that  since  *  0  any  value  of  K(0) 
will  satisfy  the  optimality  conditions.  In  practice,  however,  an 
initial  bound  must  be  determined  for  K(t). 

The  Legendre  condition  is  obtained  from  (4.6)  as 

^  -  -  R..  s.*  <  0  (4.12) 


=  0 


i.  j  t  m 


The  Weierstrass  necessary  condition  is  implied  by  (4.12)  when  the 
extremal  is  nonsingular  (reference  [30]). 

It  should  be  noted  that  even  though  a  solution  to  the  canonical 
equations  (4.9)  and  (4.11)  may  exist  V  t  €  [0,  T],  the  gain  given 
by  (4.8)  may  not  exist  as  a  solution  to  the  optimization  problem.  Thi 
is  because  the  sensitivity  vector  (4.11)  may  be  such  that  Sj(t' )  *  0 
for  some  J  and  t*  ^  (0,  T].  When  this  occurs  the  extremal  becomes 
singular, 

3^  Hi 
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and  sufficiency  conditions  are  not  satisfied.  This  will  be  discussed 
In  greater  detail  In  section  4.5. 


4.3  Necessary  Conditions  for  Mlnlmuin  Sensitivity  with  Control  Feed¬ 
back  Cost 

In  a  manner  similar  to  that  of  the  previous  section,  necessary 
conditions  ca4r)  be  obtained  for  the  problem  of  minimizing  (4.5)  with 
replaced  by  F2-  The  Hamiltonian  Is 


H2(t,  i.  K,  e)  =  -  J  Qs  -  sVrKs 


(4.13 


+  [As.  +  bk£  +  £. 


The  adjoint  equation  Is 


£  =  -  V^H2  =  Qs  +  K'rKs  -  a'  e  -  K'b'  b. 

with  g(T)  *  -  D  s(T) 

The  gain  K(t)  Is  determined  by 

3Hj  r  n  n 

3ir..  =  [  I  Z  ^  Pm  ]  S.  «  0 

^  4*1  m*l  in«l  ^ 

or  In  vector  form  when  Sj  0  for  some  j 

-  RKs  +  B^£  -  0 


(4.14 


(4.15 


Substituting  the  above  In  (4.14)  and  (4.4)  results  In  the  following 
canonical  equations, 

£  =  -  a'^£  +  QS  ;  £(T)  »  -  DS(T)  (4.16 

£  *  A£  +  BR"^B^£  +  £  i  s(0)  »  0  (4.17 


which  are  easily  solved  when  the  system  and  cost  matrices  are  time 
Invariant.  Equation  (4.15)  however  does  not  explicitly  determine  the 
optimal  gain  K(t)  since  only  r  conditions  are  given  for  the  (rxn) 
matrix.  This  occurs  because  the  cost  function  weights  only  the  r 
dimensional  control  elements.  Thus  additional  conditions  are  required 
to  completely  determine  the  gain  matrix.  It  should  be  noted  that 
equations  (4.15)  through  (4.17)  with  £(t}  i  0  and  £(0)  t  0  are  equ1va> 
lent  to  the  solution  of  the  regulator  problem  described  In  [11]. 

The  additional  condition  Imposed  on  that  problem  to  uniquely  determine 
the  gain  function  Is  that  the  differential  (Riccatl)  equation  satisfied 
by  K(t)  must  hold  for  all  This  cannot  be  done  when  £(t)  ^0  since 
(4.16)  and  (4.17)  then  generate  a  particular  sensitivity  vector  s.(t) 
from  s^(0)  *  0. 

4.4  Extension  to  Multi  parameter  Variations 

It  will  Initially  be  assumed  that  the  original  system  equation 
(4.1)  Is  linear  with  a  single  Input  and  In  phase  variable  canonical 
form  (reference  [39]).  Thus  (4.1)  and  (4.2)  become 

^=A)^+BKx  +  B  u^(t)  (4.18) 

where 


The  dynamics  are  therefore  a  function  of  n  parameters 
Corresponding  to  each  parameter  a  sensitivity  equation  can  be 
determined  as  follows: 

+  BK  (4.19) 

where  *  [  0,...,0,  x^]  with  x^  the  1th  component  of  the  nominal 
solution  of  (4.18).  Also,  a  control  feedback  cost  function  (section 
4.3)  can  be  formulated  to  minimize  the  effects  of  the  parameter  r)^> 
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The  optimal  gain  must  then  satisfy 

K  s^  =  RT^  (4.20) 

where  and  are  determined  from  equations  similar  to  (4.16)  and 

(4.17).  Define  the  sensitivity  and  adjoint  matrices  S  and  P  as 
follows: 


P  =  [  6^  £l  . 3  . 

Then  equation  (4.20)  when  combined  becomes 

K  S  =  P  .  (4.21) 

If  the  sensitivity  vectors  l^(t)  are  linearly  Independent  Y  t  e  (0,T], 
the  mul t1 parameter  minimum  sensitivity  feedback  gain  Is  given  by 

K  *  P  S"^  .  (4.22) 

Since  1^(0)  =0,  K  must  be  bounded  at  t  =  0. 

The  above  analysis  need  not  be  restricted  to  single  input  linear 
systems  in  phase  variable  canonical  form,  although  at  least  n  parameters 
must  be  Involved  and  the  sensitivity  vectors  must  be  linearly  Independ¬ 
ent.  If  the  number  of  parameters  Is  less  than  n,  a  combination  of  the 
feedback  costs  F-j  and  can  be  enployed  to  determine  the  optimal  gain. 

The  existence  of  the  optimal  gain  (4.22)  Is  determined  by  the 
linear  Independence  of  the  sensitivity  vectors  s^(t).  This  Is  because, 
from  section  4.3,  the  gain  equation  (4.20)  holds  If  only  one  component 
of  i,.j(t)  Is  nonzero.  Thus  If  the  matrix  S  is  nonsingular  Y  t  e  (0,T], 
(4.20)  holds  Yi  . 
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4.5  Sufficient  Conditions  for  Minimum  Sensitivity  with  State  Feedback 
Cost 

The  possibility  of  nonexistent  solutions  to  the  minimum  sensitiv¬ 
ity  problem  with  state  feedback  cost  was  briefly  discussed  In  section 
4.2.  In  this  section,  the  material  In  Appendix  B  Is  used  to  strengthen 
the  necessary  conditions  to  obtain  the  following  existence  theorem. 

Theorem  4.5:  The  gain  matrix  K(t)  given  by  (4.8),  (4.9)  and  (4.11) 
exists  on  (0,T]  as  a  minimum  of  (4.5)  subject  to  (4.4)  if 

s.Mt)  >0  -if  t  €  (0.  t]  (4.23) 

J 

where  Sj(t)  is  the  jth  component  of  the  solution  to  (4.11). 

Proof:  From  Appendix  B  the  existence  of  a  weak  minimum  requires 
satisfaction  of  conditions  1),  2),  3)  and  5).  Since  (4.8),  (4.9)  and 
(4.11)  are  the  extremal  equations,  condition  1)  is  automatically 
satisfied.  In  addition,  (4.12)  and  (4.23)  imply  conditions  2)  and  3) 
and  thus  it  remains  to  check  for  conjugate  points.  The  (nxm)  matrix 
elements  of  (B.5)  are  determined  from  (4.6)  through  (4.11)  to  be 


From  the  definitions  of  the  cost  function  (4.5)  and  of  the  (rxr) 
matrix  V  (4.10)  the  matrices  iipp,  and  D  are  positive  seml-definite 
on  (0,T].  Thus  by  Theorems  B.l  and  B.2,  no  conjugate  points  exist  and 
the  proof  Is  complete. 

From  the  above  theorem,  the  existence  of  the  minimum  sensitive 
gain  Is  determined  mainly  by  (4.23)  which  Is  a  somewhat  strong  condition 
and  definitely  not  satisfied  for  arbitrary  cost  parameters  D,  Q  and 
R  In  (4.5)  and  arbitrary  functions  ^(t)  In  (4.11).  This  Is,  however, 
the  price  of  achieving  linearity  of  the  canonical  equations  (4.9)  and 
(4.11).  For  a  given  system,  cost  function  and  nominal  trajectory, 
these  equations  can  easily  be  solved  to  determine  If  (4.23)  Is 
satisfied.  If  not,  the  nonsingular  approximate  problem  formulated 
In  the  next  section  can  be  employed  to  obtain  the  optimal  gain. 


In  some  cases  when  (4.23)  does  not  hold,  the  canonical  equations 
(4.9)  and  (4.11)  can  be  adjusted  such  that  (4.23)  Is  satisfied.  The 
form  of  these  equations  closely  resembles  that  of  the  canonical 
equations  for  the  regulator  with  £«  0.  Since  the  regulator  gain  holds 
for  arbitrary  initial  conditions,  it  is  plausible  that  the  magnitude 
of  the  initial  sensitivity  vector  in  (4.11),  s.(0),  could  be  increased 
from  zero  such  that  the  effect  of  c[(t)  becomes  increasingly  less 
important  in  the  solution  for  K(t).  In  order  to  do  this  the  sign  of 
s.(0)  must  be  consistent  with  that  of  the  trajectory  generated  by  a,(t). 
The  initial  sensitivity  vector  s^O)  is  thus  treated  as  a  parameter  in 
the  optimization  problem  which  may  be  adjusted  such  that  sufficiency 
conditions  are  satisfied.  This  method  was  successfully  employed  in 
the  example  discussed  in  Chapter  5. 

4.6  A  Nonsingular  Sensitivity  Problem 
Necessary  Conditions 

The  results  of  the  previous  section  indicate  that  singular 
solutions  of  the  minimum  sensitivity  problem  with  state  feedback  cost 
are  the  major  cause  for  failure  of  the  existence  conditions.  The 
problem  will  be  reformulated  in  this  section  such  that  all  extremals 
are  nonsingular.  As  a  consequence  of  this,  the  canonical  equations 
become  nonlinear  and  must  be  solved  either  by  approximation  or 
iterative  techniques. 

Examination  of  (4.23)  and  (4.8)  reveals  that  singularities  in 
the  optimal  gain  are  synonymous  with  singular  extremals.  The  cost 
function  (4.5)  will  therefore  be  modified  to  include  a  penality 
term  for  large  feedback  gains  as  follows: 


with 


0(K)  =  i  J(T)  D  s(T)  +  I  /^  [  /qs  +  G]  dt 

0 


G  » 


r 

Z 

i«1 


n 


z 

J-1 


2 


s. 

0 


+ 


Eij  '^ij ) 


(4.25) 
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and  >  0  ¥  1,j.  The  Hamiltonian  for  the  problem  of  minimizing 
(4.25)  subject  to  (4.4)  Is 

H3  (t,  1.  K.  p)  *  -  ^  J  Qs  -  6  +  [  As  +  BKs.  +  a  3.(4. 26) 

The  adjoint  equation  Is 

i  *  -  75H3  *  Qs  +  ^  7^6  -  -  ^''bK  (4.27) 

with 

B.(T)  =  -  D  s(T)  . 

The  component  of  the  feedback  term  In  (4.27)  Is  evaluated  as 


1 

I 


ii  .  i 


3s 


t-1 


"u  SI 


Equation  (4.27)  thus  becomes 

a  =  -  C  A  +  BK  f  E.  +  [  Q  +  X(K)  ]  s 
with  the  (nxn)  matrix  X  defined  as 

“^li 

0  t  ^  m 


(4.28) 


The  optimality  condition  Is  obtained  from  equation  (4.26) 


3H3  _ 


=  -  R..  K. 


ij  '^Ij  5j*  ■  ^1j  “^Ij  *  Pt  ®)11  ^j  . 


Setting  the  above  to  zero  and  solving  for  K^j  yields 

s .  n 


Rij  V  " 


I  p  B,.  (4.30) 

t«l  ^  • 
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The  above  equation  can  be  used  to  eliminate  the  gain  variables  In  the 
canonical  equations  as  follows.  From  (4.28),  define  the  n  dimensional 


vectors 


M  =  -  kV  e.  +  X(K)  s 


or  componentwl se 


n  r 


"j  ■  -  “el  "ij  ^  "U  •'ij  • 


Substituting  (4.30)  Into  the  above  yields 


cVj  Li-i  ‘  ‘'J  . 


(4.31) 


Thus  equation  (4.28)  Is 


4  =  -  +  Q  s  +  M(s,  £) 


(4.32) 


with  £(T)  =  -  0  £(T)  and  M  given  by  (4.31) 
the  component  of  (BKs^)  Is 


Using  (4.30)  and  (4.4), 


(BKs),  =  S  I  B,„  s„ 


'  I  m=  I 


r  n 

I  B.,  I 
£=1  m=l 


*^£in  *m  ^£m 


n 

•  £ 


Pi  ®U 


Define  the  (rxr)  matrix  Z  as 
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n 

r  ^ 

I  m«1 
V  n 


1  »  y 


i  f  y 


(4.33) 


r  r  n 


(BKS),  .  I  I  I  B,  Z  B'  ,  p, 
J  1-1  yl  1*1  J*  ^  ' 


and  (4.4)  thus  becomes 


i  =  As,  +  BZ(s)B^  fi.  +  £  i  i(0)  •  0 


(4.34) 


The  canonical  equations  given  by  (4.32)  and  (4.34)  are  thus  nonlinear 
In  £  and  £. 

Sufficient  Conditions 

In  order  to  establish  existence  of  the  optimal  gain  (4.30), 
conditions  1),  2),  3)  and  5)  of  Appendix  B  must  be  satisfied. 
Condition  1)  Is  Implied  by  the  extremal  equations  (4.30),  (4.32)  and 
(4.34).  The  Legendre  condition  Is  obtained  from  (4.29). 


^1j 


^  0 


E^j)  1  *  t,  j  -  m 


(4.35) 


otherwise 


Since  E  >  0  V1,j,  the  extremal  Is  nonsingular  and  conditions  2)  and 
3)  are  always  satisfied. 

The  determination  of  conjugate  points  using  the  methods  of 
Appendix  B  Is,  In  general,  extremely  difficult.  The  second  partial 
derivative  matrices  In  (B.5)  are  nonlinear  In  ^  and  which  makes  the 

computation  of  the  conditions  for  Theorems  B.l  and  B.2  a  formidable 
task. 


SO 


The  existence  of  the  optimal  gain  for  the  scalar  case  can,  however,  be 
directly  proven  using  Theorem  5  of  [43].  With  some  manipulation,  all 
required  hypotheses  can  be  shown  to  apply.  The  most  difficult  Is  the 
determination  of  the  constant  C  for  the  system  and  cost  Inequalities. 
This  can  easily  be  obtained  If  the  term 


tl'^[0,T]  I 


Is  added  to  the  cost  J(K),  noting  that  the  minimizing  gain  will  be 
unaltered.  Cesar I's  Theorem  Is  also  applicable  to  the  vector  case 
when  =0,  ,j  .  In  general  >  0  for  some  1,j  and  then  the 
theorem  cannot  be  applied  since  the  gain  and  state  terms  are  not 
functionally  separable  It  Is  probable,  however,  that  a  slight 
modification  can  be  made  to  the  theorem  to  prove  existence  for  the 
general  case. 


Solution  Techniques 

Two  methods  of  solving  for  the  optimal  gain  matrix  (4.30)  are 
given  In  this  section.  One  Is  an  Iterative  scheme  or  gradient 
technique  as  described  In  Appendix  B.  The  other  Is  an  approximation 
'  method  that  yields  a  set  of  linear  equations  for  which  an  explicit 
solution  can  be  obtained. 

The  gradient  method  outlined  In  Appendix  B  Is  directly  applicable 
to  solving  equations  (4.4)  with  i(0)  »  0  and  (4.28)  subject  to  the 
optimality  condition  (4.29).  Equations  (4.4)  and  (4.28)  correspond 
to  (B. 13)  and  (B. 14)  respectively.  The  elements  of  (4.29)  make  up 
the  vector  used  In  computing  the  gain  Increment  (B.17)  and  the 
predicted  cost  error  (B.IS).  The  Iterative  method  given  by  steps 
a)  through  d)  effectively  generates  a  solution  K(t)  by  forcing  (4.29) 
to  approach  zero  Y  t  e  (jD,T].  The  rate  of  convergence  Is  directly 
qffected  by  the  Initial  choice  of  K(t)  and  the  step  size  matrix  N. 

These  quantities  must  be  Intuitively  determined  for  each  problem 
encountered . 
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The  objective  of  the  approximation  method  given  be1oM  Is  to 
obtain  an  explicit,  nonsingular  solution  to  the  minimum  sensitivity 
problem  with  state  feedback  cost  described  In  section  4.2.  The  method 
effectively  generates  an  approximate  solution  to  the  canonical 
equations  (4.32)  and  (4.34)  when  Is  small.  Thus  the  cost  (4.25) 
will  be  close  to  that  of  (4.5)  with  the  extremal  being  nonsingular. 

In  addition,  It  Is  assumed  that  the  sensitivity  terms  In  the  cost  have 
sufficient  weight  such  that  the  sensitivity  vector  s,(t)  Is  small. 

An  approximation  to  (4.32)  and  (4.34)  can  then  be  obtained  by  examining 
the  nonlinear  elements  M  and  Z.  From  (4.31)  the  components  of  M 
are  analytic  at  zero  relative  to  E^j  and  Sj,  I.e. 

11m  /  lim  „  \  .  /  lim  M,  \  -  0 

Thus  an  expansion  of  M.  about  zero  results  In 

J 

M  (s_,  £,  E)  •  0 
Using  this  In  (4.32)  gives 

-A^^+Qs  ;  £(T)»-Ds(T)  .  (4.36) 

It  Is  seen  from  (4.33)  that  the  matrix  Z(s,  E)  Is  not  analytic  at  zero 
since 


but 
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where  V  Is  defined  by  (4.10).  This  Is  to  be  expected  because, at 
Sj  ■  0,  the  gain  given  by  (4.8)  has  a  singularity  whereas  that  given 
by  (4.30)  Is  equal  to  zero.  Since  >  0  Yl.jand  ^(0)  «  0,  (4.33) 
Indicates  that  Z(0,  E)  -  0.  The  sensitivity  equation  (4.34)  therefore 
Initially  runs  open  loop.  As  the  magnitude  of  s.(t)  Increases,  the 
matrix  Z(s.  E)  approaches  V.  Equation  (4.34)  will  thus  be  approximated 
as  follows: 

il  =  A  s^  ;  i^(0)  =  0  ;  0<t<Ti 

(4.37) 

^2  “  A  +  BVB  3.  »  ^2^^1  ^  *— l^^l^  *  T^<t<T 


where  T^  ^  (o,  T)  Is  a  design  parameter 
and 


s(t)  = 


s^(t)  0  <  t  <  T^ 

S2(t)  T^<t<T 


Equations  (4.36)  and  (4.37)  can  be  explicitly  solved  as  a  coupled 
system.  From  (4.30),  the  optimal  gain  K(t)  Is 


n 

£ 

£=1 


Pt 


0  <  t  <  T^ 

(4.38) 

T^  <  t  <  T 


The  relationship  between  the  approximate  solution  given  above 
and  that  of  the  singular  problem  described  In  sections  4.2  and  4.5  Is 
as  follows.  The  approximation  effectively  reduces  the  time  Interval 
of  optimization  and.  In  doing  so,  generates  an  Initial  sensitivity 
vector  consistent  with  a.(t).  This  was  discussed  In  section  4.5  as  a 


possible  means  of  satisfying  existence  conditions.  The  problem  result¬ 
ing  from  some  components  of  ^(t)  approaching  zero  on  (T^.T]  still 
remains,  although  this  In  part  dictates  the  choice  of  .  When  this 
occurs,  the  approximation  of  W  by  V  on  (T^,T]  Is  no  longer  valid. 

The  choice  of  T-j  Is  further  complicated  by  the  fact  that  the  desired 
trajectory  sensitivity  may  not  be  attained  If  T^  Is  too  large. 

In  summary,  the  use  of  the  above  approximation  and  the  choice 
of  T^  Is  problem  dependent  and  related  to  the  behavior  of  £(t)  and  to  the 
desired  trajectory  sensitivity.  If  the  time  parameter  Ty  can  be 
chosen  such  that 

Sj"(t)  >  0  Yte{T^.T] 

then  equations  (4.36)  through  (4.38)  give  the  desired  solution.  If 
not,  recourse  must  be  made  to  the  gradient  method. 


Chapter  5 
Comparison  Example 


5.1  Problem  Formulation 

It  is  of  interest  to  compare  the  reduced  and  minimum  sensitivity 
solutions  discussed  in  previous  chapters.  The  techniques  outlined  in 
Chapter  3  for  obtaining  the  feedback  gain  function  effectively  represent 
the  best  of  the  known  nondynamic  methods  presently  used  for  sensitivity 
reduction.  The  solution  obtained  in  Chapter  4  minimizes  sensitivity 
relative  to  (2.34)  and  (2.37).  The  question  examined  in  this 
chapter  is  how  much  better  does  the  minimum  sensitive  (MS)  gain 
perform  relative  to  the  regulator  (R6)  and  model  following  (MF) 
solutions?  A  first  order  example  will  be  described  below. 

Let  the  original  design  system  (nominal)  be  given  by 

X  =  a^  X  +  b  Uj^  i  x(0)  *  10  (5.1) 

with  u.  *  k^  x^  obtained  from 
n  n  n 

'"u"  J  (x"  +  r  uM  dt  (5.2) 

where 

.  1  b  •  1 

T  •  1  r  -  .2,  1 

The  quantity  a^  was  chosen  positive  so  that  (5.1)  as  an  unforced 
system  would  be  unstable.  This  will  accentuate  the  effect  of  any 
variation  in  a^.  Also,  two  values  of  r  were  chosen  to  vary  the  form 
of  the  nominal  trajectory. 

The  feedback  compensator  is  given  by 

u(t)  «  u„(t)  +  k(t)  [  y(t)  -  x^(t)  ] 
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(5.3) 


where  and  are  nominal  solutions  of  (5.1)  and  (5.^).  The  actual 
(real  world)  system  Is  assumed  to  be 


y  =  1.2y  +  u(t)  ;  y(0)  «  10  (5.4) 

where  the  parameter  was  varied  20  percent  In  the  unstable  direction. 
Note  that  If  no  parameter  variations  occur,  then  y  ■  and  u  *  u^. 
Two  measures  of  the  system  error  are 

Mean  Square  -I  (y  -  x-)  dt 
0 

(5.5) 

Final  Value  =  |  y(l)  -  x^(l)  | 


The  cost  of  using  feedback  Is  measured  by 


Feedback  Cost  =  /^u  -  u„)  dt  .  (5.6) 

0 

Note  that  If  (5.4)  Is  run  open  loop,  then  u  =  u^  and  no  cost  penality 
Is  Incurred. 


The  MS  compensator  Is  determined  as  a  solution  to  the  following 
probl em 


subject  to 


min 

K 


S“(1)  ♦  T  /’  (qs*  ♦  kV)  dtl 

0  -J 

(6.7) 

+  bks  +  x^(t)  ;  s(0)  =  0 

(5.8) 

which  corresponds  to  that  posed  In  section  2.4.  The  regulator  gain  Is 
also  obtained  from  (5.7)  and  (5.8)  but  with  x^(t)  •  0  and  s(0)  t  0. 

For  the  first  order  case,  the  model  following  control  Is  a  constant 
negative  gain  such  that  (5.4)  Is  stabilized. 

In  this  example,  the  gain  k(t)  Is  chosen  either  as  a  solution 
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to  (5.7)  and  (5.8)  for  various  values  of  d  and  q  or  as  a  variable 
negative  constant  k(t)  ■  -  k^.  This  determines  the  feedback  control 
(5.3)  to  be  used  In  the  actual  system  (5.4).  Equation  (5.4)  Is  then 
Integrated  to  obtain  the  performance  measures  (5.5)  and  (5.6).  A 
comparison  of  the  feedback  cost  required  to  obtain  a  given  sensitivity 
reduction  can  thus  be  obtained  for  the  MS,  RG  and  MF  compensators  by 
varying  d,  q  and  k^. 

5.2  Numerical  Results 

The  problem  posed  In  the  previous  section  was  programmed  on  a 
digital  computer  with  Runge-Kutta  techniques  used  to  Integrate  (5.4), 
(5.5)  and  (5.6).  The  major  results  are  shown  In  Figures  5.1  through 
5.4.  In  each  case  an  open  loop  trajectory  was  generated  with  k(t)  =  0. 
A  suitable  goal  for  error  reduction  with  feedback  was  then  taken  as 
10  percent  of  the  open  loop  error. 

Figures  5.1  and  5.2  present  the  comparison  results  for  a 
decreasing  nominal  trajectory,  x^(t),  obtained  with  r  =  .2  In  (5.2). 

It  Is  seen  that  the  MS  and  MF  compensators  respectively  give  the  low¬ 
est  and  highest  errors  for  equivalent  feedback  costs.  To  achieve  ten 
percent  of  the  open  loop  mean  squared  error.  Figure  5.1  Indicates  that 
the  MS  gain  requires  30  percent  less  feedback  effort  than  does  the 
regulator.  The  reduction  of  the  final  error  Is  not  as  great  In  Figure 
5.2,  however,  the  final  value  sensitivity  cost  term,  d.  In  (5.7)  was 
zero  for  those  runs. 

Similar  results  are  depicted  In  Figures  5.3  and  5.4  for  an 
approximately  constant  nonimal  trajectory  obtained  with  r  =  1  In  (5.2). 
To  achieve  10  percent  of  the  open  loop  mean  squared  error,  the  MS 
gain  requires  50  percent  less  feedback  effort  than  does  the  regulator. 
The  MS  gain  did  not  always  exist,  as  was  discussed  In  section  4.5. 

This  situation  was  remedied  by  employing  a  nonzero  Initial  sensitivity 
term.  The  results  are  shown  In  the  figures  which  Indicate  that  the 
MS  gain  still  gives  a  significant  performance  Improvement  over  that 
of  the  regulator. 
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5.3  Discussion 

Some  observations  can  be  made  concerning  the  MS  and  regulator 
gains  which  are  both  time  varying.  It  appears  that  the  existence  of 
the  MS  gain  Is  determined  In  part  by  the  stability  of  the  nominal 
trajectory.  Some  cases  were  run  with  an  Increasing  nominal  trajectory 
which  resulted  In  greater  existence  problems  than  those  of  Figures  5.3 
and  5.4.  Also  the  Inclusion  of  small  final  value  constraints 
(d  >  0  In  (5.7))  for  the  MS  and  regulator  gains  gave  no  signif¬ 
icant  relative  performance  change.  In  addition,  runs  were  made  with 
a  stable  nominal  trajectory  (a^  =  -1  In  equation  (5.1)).  Less 
performance  difference  between  the  MS  and  regulator  occurred  than  with 
the  unstable  nominal.  This  Is  to  be  expected  since  stable  systems 
automatically  reduce  the  effects  of  disturbances. 

One  possible  drawback  In  using  the  MS  gain  over  the  regulator 
Is  that  the  former  Is  more  susceptible  to  measurement  errors.  Since 
the  MS  gain  must  Initially  be  bounded,  It  will  In  general  have  a 
larger  average  magnitude  over  the  Interval  than  will  the  regulator. 
However,  If  the  parameter  variations  are  of  significant  magnitude  and 
adequate  preflltering  Is  done,  measurement  noise  should  produce 
negll gable  effects. 


Norn.  Traj.:  10-2.9 

Open  Loop  Error:  1.16 

Parameter  Values 

MS:  q  =  1-10,  d  =  0 

RG:  q  =  5-40,  d  =  0 

MF:  k  =  2-15 
0 

---  10%  O.L.  Error 
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Feedback  Cost 


Figure  5.1  Mean  Square  Error 
vs 

Feedback  Cost  for  Decreasing  Nominal  Trajectory 


Error 


Nom.  Traj.:  10-2.9 
Open  Loop  Error:  1.97 
Parameter  Values 
MS:  q  ■  1-10,  d  *  0 
RG:  q  «  5-40,  d  «  0 
MF:  «  2-15 

—  lOX  O.L.  Error 


Nom.  Traj:  10-12.3 
Open  Loop  Error:  3.14 
Parameter  Values 
MS:  q  »  1-10,  d  *  0 
RG:  q  «  2-20,  d  «  0 
MF:  »  1-4 

—  lO*  O.L.  Error 
-  S(0)  «  1 
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Figure  5.3:  Mean  Square  Error 
vs 

Feedback  Cost  for  Approximately  Constant  Nominal  Trajectory 
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Chapter  6 


Conclusions 


6.1  Summary 

A  major  contribution  of  this  dissertation  Is  the  formulation  of 
the  trajectory  sensitivity  problem  as  a  direction  field  problem  In  the 
calculus  of  variations.  This  formulation  Is  unique  In  that  It  Is 
applicable  to  a  large  class  of  nonlinear  systems  which  previously 
could  not  be  handled  by  standard  sensitivity  methods.  It  also  has  the 
desirable  property  of  reducing,  under  certain  conditions,  to  the 
classical  formulation  of  the  sensitivity  problem. 

The  principal  result  obtained  from  the  new  formulation  Is  the 
development  of  a  theory  for  the  practical  design  of  linear  feedback 
compensators  which  minimize  trajectory  sensitivity.  With  the  assump¬ 
tions  of  small  parameter  variations  and  quadratic  sensitivity  cost 
terms,  the  general  problem  reduces  to  one  for  which  an  explicit 
noniterative  solution  can  be  obtained  for  a  linear  feedback  gain 
function.  The  necessary  and  sufficient  conditions  developed  for  the 
minimum  sensitive  gain  effectively  extend  the  regulator  theory 
.  developed  by  Kalman  to  Include  unknown  constant  disturbances. 

6.2  Extensions 

There  are  at  least  three  ways  In  which  the  results  of  this 
dissertation  can  be  extended.  The  first  and  probably  the  most  fruitful 
Is  to  generate  the  linear  feedback  controls  In  section  2.4  from  dynamic 
systems.  The  possible  advantages  of  this  over  pure  gain  feedback  are 
that  the  singularity  problems  could  be  removed  by  Including  rate 
limiting  terms  In  the  cost  and  that  the  sensitivity  to  measurement 
disturbances  might  be  decreased.  Also,  In  view  of  the  advantages  of 
the  minimum  sensitive  gain  control  over  least  square  parameter  estima¬ 
tors,  a  comparison  between  dynamic  minimum  sensitive  controllers  and 
dynamic  parameter  estimators  (Kalman  filter  or  observer)  could  yield 
equivalent  results. 


The  direction  field  formulation  of  the  sensitivity  problem  can  be 
extended  to  Include  system  functions  which  exhibit  convergence  In  the 
mean  on  the  parameter  set  Instead  of  being  continuously  differentable 
relative  to  the  parameter  vector.  This  will  require  a  slight  modifi¬ 
cation  to  Gamkrelidze's  proof  of  the  necessary  conditions  for  an 
extremal . 

The  first  order  sensitivity  problem  derived  In  section  2.4  could 
be  generalized  to  Include  higher  order  sensitivity  terms  by  relaxing 
the  assumption  of  small  parameter  variations.  In  fact,  the  problem 
could  be  formulated  In  an  Infinite  dimensional  space  to  minimize  all 
orders  of  trajectory  sensitivity.  This  would  cause  the  general  solution 
to  be  completely  Independent  of  parameter  errors. 
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Appendix  A 


Functional  Analysis  Formulation 
of  the  Trajectory  Sensitivity  Problem 

This  appendix  explicitly  relates  the  Ideas  and  techniques 
developed  In  Chapters  2  and  4  to  classical  sensitivity  methods  for 
linear  systems  discussed  In  Chapter  1.  The  sensitivity  reduction 
and  disturbance  rejection  characteristics  of  forward  loop  and  Input 
compensators  are  shown  to  be  equivalent.  It  Is  also  demonstrated 
that  the  linear  feedback  con^ensator  of  section  2.4  Is  similar  In 
structure  to  classical  input  compensators.  The  most  Interesting 
result  obtained  Is  the  correspondence  between  the  measurement  noise 
transfer  function  and  the  closed  loop  system  error  Introduced  In 
Chapter  2  to  limit  the  amount  of  applied  feedback. 

Let  the  closed  loop  system  be  represented  by 


Figure  A.l:  Combined  Closed  Loop  System 


69 


where  the  linear  operators  6,  K  and  H  are  defined  on  appropriate 


Banach  spaces,  the  d^,  1  >  represent  unknown  disturbances  and 
5P  is  an  additive  linear  variation  In  the  nominal  plant.  The  desired 
or  nominal  output  is  given  by 


^3n  *  Po  Mo 


(A.l) 


The  open  loop  system,  H-K»0andG»I,  yields 


X30  “  ^3  +  P^  +  Pd^  +  Pu^ 


(A.2) 


where  P  =  P^  +  6P  is  the  actual  plant  operator.  If  the  sensitivity 


operator  is  defined  as 


N  =  [  I  -  PGH  -  PK  ] 


-1 


(A.3) 


then  the  output  of  the  closed  loop  system  is 


X3C  =  N  [  d3  +  P^  +  PGd^  +  PGH^  +  PK^  +  PGu^  ]  ,  (A. 4) 

To  make  the  above  nominally  equivalent  relative  to  (A.l)  when  d ^  ”  0  , 
i  =  1,...,4,  and  P  =  P^,  the  compensator  must  be 

G  =  [  I  -  K  Pq  ]  [  I  ♦  H  Pq  ]’^  .  {A.5) 

Let  the  closed  loop  error  be  given  by  6x^  »  2^3^.  -  ^3^  and  similarily 

the  open  loop  error  by  =  X3Q  -  53^.  Then  from  (A.l)  through  (A.5) 
the  following  holds 

^  =  N  6Xq  +  [  N  -  I  ]  (^  -  P^d^)  ,  (A.6) 

The  above  indicates  that  when  feedback  is  applied  to  make  N  a  contra¬ 
diction  operator  (approach  zero)  and  thus  reduce  the  effects  of  the 
open  loop  system  errors,  a  corresponding  increase  occurs  in  the  output 
error  due  to  measurement  noise.  This  result  is  similar  to  that 


obtained  in  Chapter  3.  Equation  (A. 6)  also  shows  that  Input  compen¬ 
sation  (H  -  0)  and  forward  loop  compensation  (K  «  0)  have  Identical 
error  rejection  characteristics. 

When  Input  compensation  Is  employed,  the  plant  Input  Is 


where  a11  disturbances  are  assumed  zero.  Using  (A. 5)  the  above  becomes 
“p  =  [  I  -  It  %  ]  Up  *  K 

or  from  (A.l) 

u^  =  u^  +  K  [  X3  -  X3^  ]  (A. 7) 

which  Is  similar  in  form  to  the  MS  compensator  of  Chapter  4. 

The  transfer  function  for  measurement  noise  Is  obtained  from  (A. 4) 
as 

=  N  P  [  G  H  +  K  ]  ,  (A.8) 

The  closed  loop  system  error,  AS,  as  defined  In  Chapter  2  Is  given  by 
the  difference  between  the  closed  loop  and  open  loop  transfer  functions 
when  only  parameter  variations  occur.  Thus  from  (A. 2)  and  (A. 4) 

AS  =  N  P  G  -  P  ,  (A. 9) 

Using  (A. 3)  and  (A. 5)  the  above  reduces  to 

AS=NP[GH+K]6P  .  (A. 10) 

It  Is  therefore  seen  that  the  closed  loop  system  error  (A. 10),  norm¬ 
alized  with  respect  to  the  parameter  variations,  Is  Identical  to  the 
transfer  function  (A.8)  for  measurement  noise. 
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Appendix  B 

Existence  and  Solution  Techniques 
for  Variational  Problems 


B.1  Necessary  and  Sufficient  Conditions  for  a  Relative  Minimum 

Sufficient  conditions  are  determined  in  this  section  which  are 
mainly  applicable  to  the  problems  considered  in  Chapter  4.  Some  new 
results  are  derived  for  the  existence  of  conjugate  points  and  their 
relationship  to  controllability.  The  variational  problem  considered 
is  stated  as  follows: 

'"I"  J(T,  s.  K)  =  i|>(T.  s)  +  L(t,  s.  K)  dt  (B.l) 

0  ~ 

subject  to 

i  *  l(t.  s.  K)  ,  s(0)  *  s^  (B.2) 

where  the  functions  L  and  f_  are  continuous  in  t  and  C‘  WRT  £  and  K, 
£  is  an  n  dimensional  vector  and  K  an  (rxn)  array.  It  is  assumed  that 
the  endpoint  of  ^  Is  free,  the  time  Intertval  T  is  fixed  and  K  is  un¬ 
constrained.  Defining  the  Hamiltonian  as 

H(t.  s,  R,  K)  =  -  L(t,  s,  K)  +  ^  f(t,  s.  K) 

where  R(t)  is  an  n  vector,  the  following  conditions  can  be  defined 
concerning  the  solution  of  (B.1)  and  (B.2}. 

1)  There  exists  an  absolutely  continuous  vector  R(t)  which 
satisfies 

i  -  -[3H/3s,...3H/3s_f  ^  -  7  H  ;  r(T)  «  -7j|<l 

ins  ^  t«T 

with 


S  -  7  H 


;  s(o)  «  ^ 


and  where  K  Is  determined  from 

IS  ^  H.  -  0  ,  ¥  l.j  . 

A  solution  of  the  above  equations  (s^{t),  £^{t),  K^Ct))  Is 
called  an  extremal. 

2)  The  extremal  Is  nonsingular,  I.e., 

DET  - 

L  5% 

3)  Legendre  -  the  matrix 


Is  negative  definite  along  the  extremal. 

4)  Welerstrass  -  The  function 

E(t,  S^,  K^,  K)  =  H{t,  S^,  K^,  -  H(t,  s^,  K,  £^) 

Is  such  that  E  >  0  along  the  extremal  Y  K. 

5)  No  conjugate  points  exist  on  the  half  closed  Interval  (0,  T]. 

From  references  [30]  and  [40],  necessary  conditions  for  a  relative  mini¬ 
mum  are  1),  3),  4}  and  5}  with  3)  and  5)  relaxed  as  follows.  The 
Legendre  condition  requires  only  negative  semi -definiteness  and  conju¬ 
gate  points  need  be  considered  only  on  the  open  Interval. 

Sufficient  conditions  for  a  relative  minimum  In  (t,  s^,  £)  space 
(weak  min)  are  1),  2),  3)  and  5).  For  a  strong  minimum  In  (t,  s.) 
space,  these  conditions  must  be  strengthened  by  requiring  3)  or  4) 
to  hold  In  some  neighborhood  of  the  extremal.  In  what  follows,  only 
weak  minima  will  be  considered.  Since  the  existence  of  conjugate  points 
Is  somewhat  difficult  to  determine,  the  next  few  paragraphs  are  Included 
to  give  a  simple  explalnatlon  of  them  along  with  necessary  and  sufficient 
conditions  for  their  existence. 
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As  in  ordinary  calculus,  the  existence  of  a  minimum  is  directly 
related  to  the  positiveness  of  the  second  derivative  or  variation  of 
the  function.  The  second  variation  of  (B.l)  subject  to  variations 
5K  about  the  extremal  determined  from  1)  is 


3*J  =  J  aJd)  [aVas^]  6s(t)  +  i  E6s  6K] 

L^KsV 


(B.3) 


where  6^(t)  is  obtained  from 

<Sj=  |j<Sl  +  |J6K  ;  6s.(0)  =  0  (B.4) 

and  all  partials  and  variations  are  defined  relative  to  the  extremal. 
One  method  of  showing  that  >  0  ¥  6K  /  0  is  to  prove  that  6*J 
does  not  have  a  minimum  WRT  6K.  To  this  end,  the  necessary  conditions 
for  a  minimum  of  (B.3)  subject  to  (B.4)  yield  the  canonical  equations 


6s(0)  =  0  •,  5b.(T)  =  -D  6s(T)  (B.6) 

where  6g^(t)  is  an  n  vector  and 

H(t,  s ,  bJ  =  H(t,  s,  B.,  K) 


D  =  aVas* 

If  it  can  be  shown  that  (B.5)  subject  to  (B.6)  does  not  have  a  solution 
on  [0,  T],  then  the  necessary  conditions  are  not  satisfied  and  6*J  >  0. 
Thus  consider  variations  5s_ and  6b.  which  satisfy  only  the  terminal 
condition  of  (B.6).  A  conjugate  point  will  be  defined  relative  to  the 
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final  time  as  1;i  £41], Instead  of  the  Initial  time. so  that  terminal 
conditions  can  be  more  adequately  accounted  for. 

Definition:  A  conjugate  point  occurs  at  t  e  £o,  T)  If 
3  a  nontrivial  solution  (6£,  5^)  to  (B.5)  on  (t^,  T] 
satisfying  g,(T)  *  -D  6s_(T)  such  that  6s(t  )  *  0. 

If  a  conjugate  point  exists,  then  the  nonzero  variation, 

fasCt).  6£(t) 

6s'  (t),  6£'  (t) 

I  0  .  %{t)  0  <  t  <  t^ 

where  6fi^  -  6£^  ;  6£Q(tj.)  =  6£(tj.) 

Is  a  solution  to  (B.5)  subject  to  (B.6). 

The  following  theorem,  which  evolved  from  a  definition  of  con¬ 
jugate  points  in  [40]  and  [41],  gives  explicit  conditions  for  their 
nonexistence. 

Theorem  B.l :  A  necessary  and  sufficient  condition  for  no  con¬ 
jugate  points  to  exist  on  [0,T)  relative  to  the  problem  defined  by 
(B.l)  and  (B.2)  Is  that  the  (nxn)  matrix  e(t,  T)  be  nonsingular  on 
[0,  T)  where 

e  (t.T)  «  [  i|(^^(t.  T)  -  T)  D  ]  (B.7) 

and 

4'ii(t,  T)  <{^12(t,  T) 

'l>2l(t,  T)  ^22^^* 

Is  the  (2n  x  2n)  transition  matrix  of  (B.5)  with  D  defined  by  (B.6). 
Proof:  Using  (B.8)  the  solution  of  (B.5)  can  be  represented  as 
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(B.9) 


6s(t)  =  T)  6s(T)  +  T)  6£CT) 

5£(t)  =  ^  ’^22^^*  • 

Then  with  (B.6)  the  above  becomes 


6s(t)  =  0(t,  T)  6s(T) 

6R(t)  =  [  il/2^(t,  T)  -  ip22(t.  T)  D]6s.(T) 


(B.IO) 


It  Is  therefore  seen  that  any  nontrival  variation  must  result  from  a 
nonzero  6£(T).  To  prove  sufficiency,  assume  that  3  a  conjugate  point 
at  t^  e  [0,  T).  Thus  from  (B.IO) 


0  =  0(t^,  T)  6s(T) 


which,  since  0(t  ,  T)  Is  nonsingular.  Implies  that  6£(T)  •  0,  a  contrl- 
diction.  To  prove  necessity  assume  that  3  a  t'e  [0,  T)  st  0(t'  ,T)  Is 
singular.  Then  3  a  nonzero  vector  6  st 

0  *  0(t'  ,  T)  6  . 

Defining  6s_(T)  *  the  continuity  of  0(t,  T)  and  the  fact  that 
0(T,  T)  *  I  Imply  that  6^{t)  f  0  for  some  t  €  (t'  ,  T)  near  T.  Therefore, 
by  definition, a  conjugate  point  occurs  at  t'  .  This  contrl diction  thus 
completes  the  proof. 

Since  the  transition  matrix  for  time  varying  systems  Is  In 
general  difficult  to  obtain.  Its  determination  can  be  bypassed  with 
the  following. 

Theorem  B.2:  If  the  matrices  ff__,  -ff..  and  D  defined  by  (B.5) 
-  pp  ss 

and  (B.6)  are  positive  semidefinite  on  [0,  T],then  no  conjugate  points 
exist  on  [0,T). 

Proof:  Assume  that  3  a  t'  €  [o,  T)  such  that  0(t'  ,T)  Is  not 


Invertable.  Then  3  a  nonzero  constant  vector  3  st 


0  -  e(t'  .  T)  S  . 

With  some  manipulation,  the  following  equation  can  be  obtained  from 
(B.5) 


6^{t)  6s(t)  »  6£'‘(T)  «s(T)  +  Hpp6£  -  6^  6s)  dt  , 

Let  6^(T)  *  6^  and  t  =  t'  ,  then  from  (B.6)  and  (B.IO) 

0  »  -  6s'^(T)  D  6s(T)  -  (6fi.^  6£  +  6s^  (-ffj  6s)  dx  . 

pp-  —  »s 

Since  D  and  are  positive  sem1<lef1n1te,the  above  Implies  that 

-  <^6-^  ’*pp  «e)  «T  >  0  • 

But  then 

Rpp  *  0  V  t  e  if  ,  T] 

because  of  the  positive  semWeflnlteness  and  continuity  of  Rpp.  The 
6£  term  In  (B.S)  Is  thus  uncoupled  from  62.  and 

6s(t)  »  <|.(t,  T)  6s(T) 

holds  V  t  €  [t'  ,  T]  where  4i(t,  T)  Is  the  transition  matrix  for 

6s  «  6s 
-ps- 

At  t  «  t'  ,  6s.(t'  )  ■  0  which  by  the  Invertablllty  of  ♦(t’  ,  T)  Implies 
that  $i{T)  ■  0,  a  contrldictlon.  Therefore  B(t'  ,  T)  roust  be  Invertable 
and  by  Theorem  B.l  the  proof  Is  complete. 

Since  the  minimization  problem  defined  by  (B.l)  and  (B.2)  has 
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variable  endpoints  ^(T)  and  fixed  time  Interval  £0,  T],  controll¬ 
ability  as  Introduced  In  [11]  does  not  play  an  Important  role  In  the 
conditions  for  an  extremal.  However,  If  the  endpoints  of  (B.2)  are 
fixed  (s_(T)  »  8,2)1  then  there  Is  a  direct  relationship  between 
controllability  and  conjugate  points  as  shown  below. 

With  fixed  endpoints, the  canonical  equations  for  the  accessory 
minimization  problem  are  given  by  (B.5)  with  (B.6)  replaced  by 

6s(0)  =  0  ;  6s(T)  =  0  .  (B.ll) 

Conjugate  points  can  now  be  defined  relative  to  the  Initial  time  t  >  0, 
which  Is  the  classical  definition  [30]. 

Theorem  B.3:  If  the  (nxn)  matrix  i|)i2(t,  0)  given  by  (B.8)  with 
T  =  0  Is  nonsingular,  then  no  conjugate  points  exist  on  (0,  T]  relative 
to  the  problem  defined  by  (B.l)  and  (B.2)  with  ^(T)  fixed. 

Proof:  This  Is  similar  to  the  first  part  of  the  proof  of 
Theorem  B.l  and  will  therefore  not  be  repeated. 

Theorem  B.4:  If  the  matrices  Hpp  and  of  (B.S)  are  positive 
semWeflnlte  on  (0,  T]  and  If  (B.5)  Is  completely  controllable,  I.e. 
the  matrix 

W(0,  t)  *  /  ^  (|»(0,  t)  <l>^(0,T  )  dx 

Is  positive  definite  ¥  t  e  (0,  T]  with  ♦(•)  the  transition  matrix  for 
Rpj,  then  no  conjugate  points  exist  on  (0,  T]  for  the  fixed  endpoint 
problem. 

Proof:  Using  Theorem  B.3,  the  proof  reduces  to  showing  that  If 
M(0,  t)  Is  positive  definite  then  nonsingular.  This  was 

shown  In  reference  [42]  which  contains  existence  theorems  for 
solutions  of  linear  two  point  boundary  value  problems. 

It  should  be  noted  that  when  (B.2)  Is  linear  and  (B.l)  quadratic, 
such  as  (4.4)  and  (4.5),  the  controllability  of  (B.5)  Is  Implied  by 
the  feedback  controllability  of  (B.2). 


78 


B.2  A  First  Order  Gradient  Method  for  the  Solution  of  Nonlinear 
Optimization  Problems 

The  gradient  method  described  below  Is  a  standard  first  order 
technique  for  solving  nonlinear  problems  (reference  144]).  The  method 
Is  simple  to  apply  although  convergence  In  some  cases  can  be  extremely 
slow.  It  Is,  however,  quite  applicable  to  the  unconstrained  m1n1m1za> 
tion  problem  defined  In  section  B.l. 

Adjoining  the  sensitivity  equation  (B.2)  to  the  cost  (B.l)  with 
multipliers  g^(t)  results  In 

0  =  i^(T,  s)  +  /^  [L(t,  s,  K)  +  (i  -  f)  ]  dt  . 

0 

Using  the  Hamiltonian  defined  In  section  (B.l),  the  above  becomes 

J  =  t|)(T,  s.)  +  /^  [  -H  (t,  s,  £,  K)  +  g^s  ]  dt 
0  ^ 

or  Integrating  by  parts 

J  *  t|»(T,  s,)  £^1  -  [H(t,  s,  £,  K)  +  ]  dt  .  (B.12) 

■o  0 

The  gradient  method  basically  consists  of  choosing  an  Initial 
value  for  the  optimal  gain  K^(t)  and  then  using  It  to  Integrate  the 
canonical  equations 

i=VpH  ,  s(0)=s^  (B.13) 

i  =  -  V^H  ,  £(T)  =  -  .  (B.14) 

A  new  gain  K2(t)  Is  determined  to  minimize  the  predicted  error  In  the 
cost  (B.12).  The  process  Is  then  repeated  until  the  cost  error  Is 
near  zero. 

The  perturbation  of  (B.12)  relative  to  5£  and  5K  Is 
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6J  a[7g  ij<}Ss.(T)  +  6s.(T) 


^  T  p  r  rtT 


r  n 


-  /  [[v;  H]6s  +  r  I  +  i'  6s  ]  dt 

0  s  -  1-1  j.l  ^  - 


Using  (B.14)  to  define  £(t),  the  above  becomes 


5J  *  -  /  '  [  I  I  6K^  ^  ]  dt 

0  1=1  j=l 


6J  =  -  /^  6K  dt 
0 


(B.15) 


where  and  6K  are  r«n  dimensional  vectors  with  elements  and 

6K^j  respectively.  In  order  to  limit  the  size  of  6K,  a  quadratic  term 
Is  added  to  (B.15)  as  follows: 


6  Jj  =  -  /^  hJ  6K  dt  -  i  6lJ  N  6K  dt 
0  0 


(B.16) 


where  N  Is  a  symmetric,  positive  definite,  (n*r  x  n»r)  dimensional 
matrix.  A  necessary  condition  for  a  minimum  of  6Jy  Is 


+  N  6K  »  0 
6K  «  - 


(B.17) 


Using  (B.17)  to  compute  the  new  gain  as 


The  cost  deviation  Is 


6J  -  ^  hJ  N"’  dt 


(B.18) 
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The  gradient  method  of  con^)ut1ng  the  optimal  gain  Is  thus  composed 
of  the  following  steps: 

a)  Choose  an  Initial  gain  K(t)  and  step  size  matrix  N. 

b)  Integrate  (B.13)  forward  from  s^  and  then  (B.14) 
backwards  to  obtain  s.(t)  and  ^{t)  on  lO,  T]. 

c)  Determine  the  new  gain  from  (B.17)  and  the  predicted 
cost  error  from  (B.18). 

d)  Repeat  the  above  steps  until  the  predicted  cost 
error  Is  approximately  zero. 
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APPENDIX  C 

Least  Square  Parameter  Estimation  and  Minimum  Sensitive  Control 
C.1  Introduction 

As  stated  In  Chapter  1,  one  solution  to  the  sensitivity  problem 
Is  to  first  estimate  the  values  of  the  unknown  parameters  and  then  use 
the  estimates  to  control  the  system  output  near  the  nominal.  The 
standard  technique  Is  to  Include  the  parameters  as  part  of  the  state 
and  to  obtain  the  augmented  state  estimates  using  a  Kalman  filter. 

Then  the  regulator  solution  can  be  used  for  feedback  control  (section 
1.2.5).  If  It  Is  assumed  that  Initial  condition  errors  are  Included 
In  the  nominal  control  and  that  the  total  state,  ^(t),  can  be  measured, 
a  nondynamic  least  square  estimate  of  the  parameters  can  be  obtained* 
from  ^(t).  The  combined  estimator  and  controller  Is  thus  given  by  a 
linear  gain  function. 

In  this  appendix  the  feedback  control  obtained  with  the  least 
square  parameter  estimator  will  be  compared  to  the  minimum  sensitive 
gain  function  derived  In  Chapter  4.  It  will  be  shown  that  both  feed* 
back  gains  have  similar  structures  when  the  number  of  uncertain 
parameters  Is  equal  to  the  dimension  of  the  state,  I.e.  m  >  n.  However, 
when  m  <  n  the  least  square  (LS)  gain  must  be  determined  by  a  nonlinear 
set  of  differential  equations  with  time  varying  coefficients. and  when 
m  >  n  the  LS  gain  doesn't  exist.  Neither  of  these  problems  occur  with 
the  MS  gain.  Other  advantages  which  result  from  employing  the  MS 
control  will  also  be  pointed  out. 

C.2  Least  Square  Controller 

Assuming  that  the  closed  loop  system  dynamics  are  described  by 
(4.1),  the  linear  perturbation  equation  Is  given  by 

4x  ■  ^  ^  ^  ^  (0)®0  (C.l) 


F 

k-: 
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where  all  partlals  are  evaluated  along  the  nominal  and  the  A  quantities 
represent  off  nominal  errors.  Any  initial  condition  error  is  assumed 
to  be  included  in  u  (t).  If  the  parameter  influence  matrix  is  defined 

by 

. 

then  the  above  equation  becomes. 

Ax  =  AAx  +  6^  ®  0  •  (^-2) 

Since  it  is  desired  to  reduce  the  trajectory  error,  ^(t),  the 
following  cost  functional  will  be  employed 

J,  *  t  ^^(T)D  MT)  +  i  /^  (  Ax^Q  %  +  Aj/r  Au  )dT  (C.3) 

where  D,  Q  and  R  are  as  defined  in  Chapter  4.  The  control  error  term 
is  included  in  the  cost  to  limit  the  amount  of  applied  feedback.  The 
minimization  of  (C.3)  subject  to  (C.2)  results  from  [11]  in  tht 
following  control 

^  «  R’^B^P^  ^  +  R’^B^Pg  ^  (C.4) 

where  the  (nxn)  and  (nxm)  matrices  P^  and  P^  satisfy 

»  a'^P^  +  P^A  +  P^BR'^b'^P^  -  Q  ;  P^(T)  =  -D  (  C.5) 

-?2  •  A^p2  +  P^G  +  P^BR’^B^Pg  i  P2(T)  •  0  .  (  C.6) 

The  zero  initial  condition  on  the  system  equation  allows  an  estimate 
of  ^  to  be  obtained  as  follows.  Using  (C.4)  in  (C.2)  and  defining 

H  ■  BR"^B^,  the  closed  loop  system  error  is  described  by 
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^  *  (A  +  HP^)  ^  +  (G  +  HPg)  ^  ;  ^(0)  *  0  (C.7) 


Ax(t)  *  /  ij/(t,T)  [  G  +  HP-  3  An  dx 
0  ^ 

where  \|)(*)  1s  the  transition  matrix  for  the  free  part  *  0)  of 
(C.7).  Since  An  Is  assumed  to  be  constant 


Ax(t)  =  W(t)  An 


where 


W(t)  =  t|)(t,T)  [  G  +  HP2  ]  dt 


(C.8) 


Differentiating  the  above  results  In 

l3  =  [  A  +  HP^  3  W  +  [  G  +  HPg  3  ;  W(0)  »  0  (C.9) 

Assuming  that  the  state  error  can  be  measured  as 

Ax(t)  =  W(t)  An  d  > 

where  d  represents  zero  mean  Gaussian  noise,  the  least  square  estimate 
of  the  parameter  error  Is  given  by 

An  =  W*(t)  Ax  (C.IO) 


where 


W'^(t)  =  [  w'^W  3'^ 


(C.ll) 


For  the  above  Inverse  to  exist,  the  number  of  uncertain  parameters 
cannot  be  greater  than  the  dimension  of  the  s'vite,  I.e.  m  <  n.  When 
m  >  n,  the  technique  described  In  this  section  for  obtaining  a  feed¬ 
back  control  Is  not  applicable.  Thus,  using  (C>10)  In  (C.4),  the 
control  becomes 


Ajj  -  [  P^  +  3  4x  . 


(C.12) 
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The  least  square  (LS)  feedback  gain  Is  therefore 

1(^(0  -  r-’b^  [  p,  ♦  PjU*  ]  (C.13; 

where  P^,  Pg  and  W”*^  are  determined  from  the  nonlinear  system  of 
equations  defined  by  (C.5),  (C.6),  (C.9)  and  (C.ll).  From  (C.12),  the 
LS  feedback  control  Is 

u(t,x)  =  U|_{t)  +  K^Ct)  x(t) 

with  (C.14) 

UL(t)  =  u^(t)  -  K^^(t)  )^(t)  . 

C.3  Comparison  with  i.^lmum  Sensitive  Feedback  Controller 

In  order  to  compare  the  least  square  feedback  gain  with  that 
derived  In  Chapter  4,  It  will  Initially  be  assumed  that  the  number  of 
uncertain  parameters  Is  equal  to  the  dimension  of  the  state  (m  =  n). 

The  results  of  sections  4.3  and  4.4  then  apply  when  the  cost  functional 
Is  given  by  (4.5)  with  F^  replaced  by  Fg  and  with  the  same  weighting 
matrices  as  (C.3).  In  particular,  for  each  component  parameter  error 
and  corresponding  column  of  [  ,  1  *  l....,m  , 

the  MS  gain  satisfies  (from  (4.15)  -  (4.17)), 

-  RMi  ♦  8^  E,  '  0 

with  1  «  1 , . . . ,m  and 

ij  *  1^1  3-1  ’ 

Rl  “  Ef  +  Q  1  ^  ••  £i(T)  =  -  D  s^(T)  . 

These  can  be  combined  as  In  section  (4.4)  to  yield 

-R  S  +  P  =  0  (C.15) 

where  the  (nxn)  matrices  S  and  P  satisfy 


§  =  AS  +  HP  +  6  ;  S{0)  *  0  , 

M  -  A^P  +  Q  S  ;  P(T)  =  -  D  S(T)  , 


{C.16) 

(C.17) 


with  H  and  G  as  previously  defined.  When  S(t)  Is  Invertable,  the 
minimum  sensitive  (MS)  gain  Is  given  by 

P  S"^  .  (C.18) 

The  remaining  problem  Is  to  correlate  the  MS  gain  (C.18)  with  the 
LS  gain  given  by  (C.13).  Since  m  *  n,  W'*'(t)  =  W‘^(t)  and  (C.13)  can 
be  written  In  the  form 

[  P^W  +  Pg  ]  W“^  .  (C.19) 

Note  that  this  Is  only  valid  for  m  *  n.  When  m  <  n,W  W^  HI  In  general 
and  (C.19)  doesn't  hold.  Let 

Pl  =  Pi  W  +  Pa  .  (C.20) 

Then  from  (C.9) 

l5  =  AW  +  H  Pj_  +  G  ;  W(0)  =  0  ,  (C.21) 

which  corresponds  In  form  to  (C.16),  By  differentiating  (C.20)  and 
using  (C.5),  (C.6)  and  (0.21)  the  following  holds 

=  -  a'*’  P^  +  Q  W  ;  Pj_(T)  *  -  D  W(T).  (C.22) 

Thus  from  (C.19)  and  (c.20)  the  LS  gain  becomes 

1(^(4)  ■  R-’  W-'  .  (C.23) 

It  Is  easily  seen  that  by  corresponding  P^  and  W  with  P  and  S 
respectively,  the  MS  and  LS  feedback  gains  have  similar  structures  when 
m  >  n.  However,  the  linear  structure  of  defining  equations  Is  a  direct 
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result  of  the  solution  for  the  MS  problem  whereas  some  manipulation 
Is  required  to  obtain  this  form  for  the  LS  solution.  The  type  of  least 
square  parameter  estimator  described  1n  this  appendix  has  been  previous 
ly  used  in  [28]  to  obtain  neighboring  optimum  solutions  to  the  cost 
sensitivity  problem,  although  the  existence  of  the  linear  solution  was 
not  recognized.  An  additional  advantage  of  the  MS  gain  is  that 
different  cost  terms  corresponding  to  each  parameter  error  component 
can  be  employed  as  in  section  4.4. 

The  strength  of  the  techniques  discussed  in  Chapter  4  is  particular 
ly  apparent  when  m  \  n.  If  m  <  n,  the  LS  gain  must  be  determined 
from  a  nonlinear  set  of  matrix  differential  equations  involving  a 
pseudo-inverse.  In  contrast,  the  MS  gain  is  determined  from  a  set  of 
linear  matrix  differential  equations  resulting  from  the  minimization 
of  a  combined  state  and  control  cost  function  (section  4.4).  When 
m  >  n,  the  LS  solution  doesn't  exist.  The  MS  gain  is  directly  computed 
from  (C.18)  with  S"^  replaced  by 

S^  =  S^  [  s  s"^  ]■'’ 

which  exists  if  the  (nxm)  matrix  S  is  at  least  of  rank  n.  It  is 
therefore  seen  that  the  results  of  Chapter  4  apply  to  a  much  larger 
class  of  problems  than  does  the  least  square  estimator.  In  addition, 
the  MS  gain  is  always  determined  from  a  set  of  linear  differential 
equations  and,  because  of  the  variational  formulation  of  the  problem, 
sufficiency  conditions  can  readily  be  obtained. 


